00000001:02000400:0.0F:1787359782.682516:0:3306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787359802.244889:0:3534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787359804.361518:0:3597:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 715 MB/s 00000001:01000000:2.0:1787359804.620275:0:3597:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 579 MB/s 00000001:01000000:2.0:1787359804.870296:0:3597:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3135 MB/s 00000020:02000000:2.0:1787359805.677339:0:3627:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_45_g4630995 00000400:02000000:0.0:1787359806.523533:0:3642:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.111@tcp [8/256/0/180] 00008000:02000000:3.0:1787359810.573261:0:3791:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787359880.608529:0:5758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787359895.569764:0:6508:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787359895.569770:0:6508:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787359895.569771:0:6508:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787359895.569925:0:6508:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008bc5d4fd 00000080:02000400:2.0:1787359895.569935:0:6508:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787359895.584441:0:6508:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787359895.584453:0:6508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787359895.584480:0:6508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006a72cc17) 00000020:00000080:2.0:1787359895.584496:0:6508:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787359895.652938:0:6508:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787359895.653049:0:6508:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787359895.666926:0:6508:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787359895.667553:0:6508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787359895.667561:0:6508:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787359895.667571:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fa83 00000020:01000004:3.0:1787359895.667577:0:6508:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787359895.667581:0:6508:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787359895.667585:0:6508:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008bc5d4fd from MGS 00000020:01000004:3.0:1787359895.667589:0:6508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787359895.667606:0:6508:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004be149d7) 00000020:00000080:3.0:1787359895.667617:0:6508:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787359895.667789:0:6508:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008bc5d4fd from MGS, refs=2 00080000:01000000:3.0:1787359895.667795:0:6508:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787359895.667801:0:6508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fa91 00000100:00100000:3.0:1787359895.667899:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787359895.668129:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787359895.668135:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787359895.668859:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787359895.668866:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787359895.669906:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359895.670166:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787359895.670172:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787359895.671590:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787359895.671607:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787359895.672133:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787359895.672140:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787359895.672887:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.672891:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.672893:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.673389:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.673392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.673393:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359895.673922:0:6508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787359895.676098:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787359895.923535:0:6508:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2763 MB/s 00000001:01000000:0.0:1787359896.177305:0:6508:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3467 MB/s 00000001:01000000:2.0:1787359896.435003:0:6508:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 564 MB/s 00000001:01000000:2.0:1787359896.685080:0:6508:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 623 MB/s 00010000:00010000:0.0:1787359896.698019:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787359896.703118:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0F:1787359896.712445:0:6508:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787359896.713754:0:6522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787359896.713792:0:6508:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787359896.713828:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787359896.714002:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787359896.714027:0:6508:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787359896.714776:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359896.715013:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787359896.715019:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787359896.715802:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787359896.715811:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787359896.717838:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787359896.717849:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787359896.721069:0:6508:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787359896.721094:0:6508:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.111@tcp' 00000020:01000004:0.0:1787359896.721096:0:6508:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787359896.721144:0:6508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.111@tcp (typ=mgc) 00000020:00000080:0.0:1787359896.721166:0:6508:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.111@tcp (00000000bfb638bf) 00000020:00000080:0.0:1787359896.721182:0:6508:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787359896.721292:0:6508:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f96f83c8@MGC192.168.206.111@tcp: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787359896.721474:0:6508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.111@tcp-0 is initialized 00000040:01000000:0.0:1787359896.721480:0:6508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787359896.725768:0:6528:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787359896.726049:0:6508:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.111@tcp (uuid a3f976a1-9d05-40f0-9d87-e3c95a944c03) 00000020:00000080:2.0:1787359896.726069:0:6508:0:(genops.c:1385:class_connect()) connect: client a3f976a1-9d05-40f0-9d87-e3c95a944c03, cookie 0x359a4e2aee71fa9f 00000100:00080000:2.0:1787359896.726082:0:6508:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787359896.726087:0:6508:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import 00000000f96f83c8 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787359896.726131:0:6508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008e773efb x1874182595936384/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787359896.726149:0:6508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS 00000020:01000004:2.0:1787359896.726164:0:6508:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787359896.726168:0:6508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787359896.726188:0:6508:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000eacee06a) 00000020:00000080:2.0:1787359896.726198:0:6508:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1787359896.727097:0:6527:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787359896.727378:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e773efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182595936384:0@lo:250: 00000100:00100000:1.0:1787359896.727447:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359896.729980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595936384 00000100:00100000:3.0:1787359896.729995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595936384 00000100:00100000:3.0:1787359896.730046:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359896.730054:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d0487aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1874182595936384:12345-0@lo:250: 00010000:00080000:3.0:1787359896.730081:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a3f976a1-9d05-40f0-9d87-e3c95a944c03@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1787359896.730123:0:6524:0:(genops.c:1385:class_connect()) connect: client a3f976a1-9d05-40f0-9d87-e3c95a944c03, cookie 0x359a4e2aee71faad 00000100:00080000:3.0:1787359896.730351:0:6524:0:(import.c:65:import_set_state_nolock()) 000000006801a4fb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359896.730456:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d0487aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:3657:x1874182595936384:12345-0@lo:250: Request processed in 401us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359896.730465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359896.730514:0:3657:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787359896.730522:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1787359896.730529:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787359896.730533:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787359896.730536:0:3657:0:(import.c:65:import_set_state_nolock()) 00000000f96f83c8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787359896.730538:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787359896.730546:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787359896.730550:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e773efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182595936384:0@lo:250: 00000100:00100000:2.0:1787359896.741364:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359896.741903:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787359896.741912:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787359896.743044:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787359896.743054:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787359896.744678:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787359896.744690:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787359896.747218:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359896.747458:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787359896.747466:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787359896.753618:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787359896.753630:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787359896.794885:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359896.795105:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787359896.795112:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787359896.797544:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787359896.797559:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787359896.798577:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359896.798749:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787359896.798754:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787359896.799604:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787359896.799614:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787359896.800533:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359896.800723:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787359896.800728:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787359896.801586:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787359896.801595:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787359896.802543:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359896.802726:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787359896.802732:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787359896.803445:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787359896.803454:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787359896.819707:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359896.819926:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787359896.819933:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787359896.821918:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787359896.821936:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787359896.822898:0:6508:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787359896.822908:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787359896.823834:0:6508:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787359896.823859:0:6508:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787359896.823865:0:6508:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787359896.823962:0:6508:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787359896.824006:0:6508:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787359896.824010:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787359896.824012:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359896.824014:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359896.824015:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359896.824016:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359896.824017:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359896.824019:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359896.824020:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359896.824022:0:6508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359896.824023:0:6508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359896.824025:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359896.824026:0:6508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359896.824028:0:6508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787359896.824030:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359896.824032:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359896.824032:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359896.824033:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359896.824034:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359896.824035:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359896.824036:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359896.824037:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359896.824038:0:6508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359896.824039:0:6508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359896.824040:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359896.824041:0:6508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359896.824071:0:6508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787359896.824086:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936512:0@lo:253: 00000100:00100000:0.0:1787359896.824150:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.825339:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000006091c6d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787359896.825435:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595936512 00000100:00100000:2.0:1787359896.825443:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595936512 00000100:00100000:2.0:1787359896.825576:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359896.825586:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e218403c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6508:x1874182595936512:12345-0@lo:253: 20000000:01000000:2.0:1787359896.825636:0:6526:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787359896.825639:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787359896.825905:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787359896.825957:0:6526:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787359896.826253:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787359896.827816:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787359896.828096:0:6526:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787359896.828101:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787359896.828106:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787359896.828109:0:6526:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787359896.828119:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787359896.828737:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359896.828906:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787359896.828922:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787359896.828938:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787359896.828954:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787359896.828968:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787359896.829044:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787359896.829053:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787359896.829067:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787359896.829074:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787359896.829087:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787359896.829092:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787359896.829105:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787359896.829119:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787359896.829145:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787359896.829150:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787359896.829493:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359896.829611:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787359896.829623:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787359896.829639:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787359896.829661:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787359896.829678:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787359896.829688:0:6526:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787359896.829713:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787359896.829721:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787359896.829733:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787359896.829750:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787359896.829774:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787359896.829783:0:6526:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787359896.829798:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787359896.829803:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787359896.829809:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787359896.829824:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787359896.829858:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787359896.829873:0:6526:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787359896.829879:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787359896.830436:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787359896.830629:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787359896.830649:0:6526:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:2.0:1787359896.830650:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787359896.830665:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787359896.830671:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787359896.830684:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787359896.830689:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1787359896.830699:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787359896.830706:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787359896.830719:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787359896.830732:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787359896.830764:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787359896.830767:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787359896.830771:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787359896.830828:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787359896.830830:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787359896.831119:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787359896.831527:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787359896.831550:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787359896.831566:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787359896.831574:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787359896.831576:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787359896.831841:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787359896.831997:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787359896.832015:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787359896.832029:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787359896.832039:0:6526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787359896.832041:0:6526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787359896.832045:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359896.832054:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359896.832059:0:6526:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787359896.832064:0:6526:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787359896.832652:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787359896.832813:0:6526:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787359896.839479:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787359896.839513:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787359896.839528:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787359896.839547:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787359896.839577:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.839592:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.839600:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.839606:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.839611:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840424:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840431:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9471538 already unused, calling callback (000000006ae1db34) 00010000:00010000:2.0:1787359896.840435:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840461:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840474:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840481:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.840486:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9471538/0x359a4e2aee71fab4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787359896.840504:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787359896.853254:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e218403c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6508:x1874182595936512:12345-0@lo:253: Request processed in 27664us (29097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359896.853269:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359896.853386:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936512:0@lo:253: 10000000:01000000:0.0:1787359896.853401:0:6508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787359896.853404:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787359896.853406:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359896.853407:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359896.853408:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787359896.853409:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359896.853410:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359896.853412:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359896.853413:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359896.853414:0:6508:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787359896.853416:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359896.853417:0:6508:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787359896.853434:0:6508:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008bc5d4fd from lustre-MDT0000 10000000:01000000:0.0:1787359896.853462:0:6508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787359896.853465:0:6508:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787359896.853468:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff998a3bac8000 10000000:01000000:0.0:1787359896.853471:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359896.853478:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a3bac8000 from 1 10000000:01000000:0.0:1787359896.853480:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359896.853512:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.853521:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.853529:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359896.853546:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936640:0@lo:101: 00000100:00100000:0.0:1787359896.853590:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.853701:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:2.0:1787359896.853758:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595936640 00000100:00100000:2.0:1787359896.853827:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595936640 00000100:00100000:2.0:1787359896.853981:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787359896.853990:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000216bff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6508:x1874182595936640:12345-0@lo:101: 00010000:00010000:2.0:1787359896.854002:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359896.854014:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fabb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.854033:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.854042:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.854062:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9471538, rc 0) 00000100:00100000:2.0:1787359896.854103:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000216bff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6508:x1874182595936640:12345-0@lo:101: Request processed in 115us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359896.854109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359896.854163:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936640:0@lo:101: 00010000:00010000:0.0:1787359896.854181:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.854189:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359896.854268:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936768:0@lo:501: 00000100:00100000:0.0:1787359896.854293:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.855150:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:3.0:1787359896.855197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595936768 00000100:00100000:3.0:1787359896.855204:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595936768 00000100:00100000:3.0:1787359896.855271:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359896.855281:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005701081e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6508:x1874182595936768:12345-0@lo:501: 00000100:00100000:3.0:1787359896.855382:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005701081e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6508:x1874182595936768:12345-0@lo:501: Request processed in 104us (1088us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787359896.855389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359896.855512:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936768:0@lo:501: 10000000:01000000:0.0:1787359896.855547:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787359896.855564:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.855573:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359896.855581:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a0ffaa800 10000000:01000000:0.0:1787359896.855586:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787359896.855589:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998a0ffaa800 10000000:01000000:0.0:1787359896.855592:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787359896.855594:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998a0ffaa800 from 1 10000000:01000000:0.0:1787359896.855597:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787359896.855627:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.855634:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.855653:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359896.855668:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936896:0@lo:101: 00000100:00100000:0.0:1787359896.855697:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.855715:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:1.0:1787359896.855776:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595936896 00000100:00100000:1.0:1787359896.855783:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595936896 00000100:00100000:1.0:1787359896.855818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359896.855826:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d718f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6508:x1874182595936896:12345-0@lo:101: 00010000:00010000:1.0:1787359896.855835:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359896.855847:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e949a81d/0x359a4e2aee71fad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fac9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359896.855865:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e949a81d/0x359a4e2aee71fad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fac9 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359896.855874:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e949a81d/0x359a4e2aee71fad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fac9 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359896.855881:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e949a81d, rc 0) 00000100:00100000:1.0:1787359896.855924:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d718f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6508:x1874182595936896:12345-0@lo:101: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359896.855930:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359896.856084:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595936896:0@lo:101: 00010000:00010000:0.0:1787359896.856095:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.856104:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359896.856117:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787359896.856130:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.856136:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000003fe99bae/0x359a4e2aee71fac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359896.856144:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787359896.856148:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359896.856152:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998a0ffaa800 10000000:01000000:0.0:1787359896.856154:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787359896.856157:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787359896.856159:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359896.856170:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.856182:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.856189:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359896.856200:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937024:0@lo:101: 00000100:00100000:0.0:1787359896.856255:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.856273:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:2.0:1787359896.856369:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937024 00000100:00100000:2.0:1787359896.856375:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937024 00000100:00100000:2.0:1787359896.856399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359896.856405:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f6e134c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6508:x1874182595937024:12345-0@lo:101: 00010000:00010000:2.0:1787359896.856412:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359896.856421:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fad7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.856434:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.856442:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359896.856448:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000691c3b37, rc 0) 00000100:00100000:2.0:1787359896.856487:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f6e134c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:6508:x1874182595937024:12345-0@lo:101: Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359896.856494:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359896.856564:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937024:0@lo:101: 00010000:00010000:0.0:1787359896.856574:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359896.856581:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359896.856638:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937152:0@lo:501: 00000100:00100000:0.0:1787359896.856662:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.856680:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:1.0:1787359896.857013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937152 00000100:00100000:1.0:1787359896.858912:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937152 00000100:00100000:1.0:1787359896.859011:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787359896.859031:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b220bf12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:6508:x1874182595937152:12345-0@lo:501: 00000100:00100000:1.0:1787359896.859187:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b220bf12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6508:x1874182595937152:12345-0@lo:501: Request processed in 158us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359896.859194:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359896.860590:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937152:0@lo:501: 00000100:00100000:0.0:1787359896.860655:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937280:0@lo:503: 00000100:00100000:0.0:1787359896.860721:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.860767:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bac0b597 going to sleep for 11 seconds 00000100:00100000:2.0:1787359896.861761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937280 00000100:00100000:2.0:1787359896.861770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937280 00000100:00100000:2.0:1787359896.861833:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359896.861842:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029d909ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6508:x1874182595937280:12345-0@lo:503: 00000100:00100000:2.0:1787359896.861990:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029d909ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6508:x1874182595937280:12345-0@lo:503: Request processed in 149us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359896.862004:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359896.862131:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a97f8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937280:0@lo:503: 00000100:00100000:0.0:1787359896.864711:0:6553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005bd4a65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6553:1874182595937408:0@lo:502: 00000100:00100000:0.0:1787359896.864785:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359896.864854:0:6553:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8f80585 going to sleep for 11 seconds 00000100:00100000:1.0:1787359896.864946:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937408 00000100:00100000:1.0:1787359896.864954:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937408 00000100:00100000:1.0:1787359896.865008:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359896.865029:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eac52d2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6553:x1874182595937408:12345-0@lo:502: 00000100:00100000:1.0:1787359896.865151:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eac52d2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6553:x1874182595937408:12345-0@lo:502: Request processed in 134us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359896.865158:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359896.867515:0:6553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005bd4a65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6553:1874182595937408:0@lo:502: 00000020:01000000:0.0:1787359896.867565:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359896.867579:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359896.867581:0:6553:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787359896.867586:0:6553:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787359896.867595:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787359896.867611:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003892ef08) 00000020:00000080:0.0:1787359896.867629:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787359896.867635:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787359896.867742:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787359896.867749:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71faec 00000020:00000080:0.0:1787359896.867985:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787359896.867991:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359896.867994:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359896.867995:0:6553:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787359896.867997:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359896.868001:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359896.868002:0:6553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787359896.868005:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787359896.868012:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f54214c9) 00000020:00000080:0.0:1787359896.868022:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787359896.868026:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787359896.868028:0:6553:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787359896.868030:0:6553:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787359896.868036:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787359896.868090:0:6553:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008bc5d4fd from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787359896.868102:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fa3f26b1) 00000020:00000080:0.0:1787359896.868109:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787359896.868181:0:6553:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787359896.868187:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71fb01 00000020:00000080:0.0:1787359896.868372:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787359896.868378:0:6553:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787359896.868388:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x359a4e2aee71fb08 00080000:01000000:0.0:1787359896.868394:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787359896.868397:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fb0f 00080000:10000000:0.0:1787359896.868778:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787359896.868923:0:6553:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787359896.876102:0:6553:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787359897.012101:0:6553:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787359897.012735:0:6553:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787359897.016583:0:6553:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787359897.017318:0:6553:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787359897.020798:0:6553:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c36c1596) 00000020:00000080:2.0:1787359897.020828:0:6553:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787359897.020920:0:6553:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787359897.020928:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fb1d 00000020:00000080:0.0:1787359897.026332:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787359897.027383:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1787359897.029579:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787359897.038313:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787359897.040543:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787359897.043861:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787359897.046192:0:6553:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787359897.049000:0:6553:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x359a4e2aee71fb24 00000020:00000080:1.0:1787359897.049638:0:6553:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787359897.049650:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359897.049656:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359897.049659:0:6553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787359897.049662:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359897.049666:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359897.049668:0:6553:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787359897.049671:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787359897.049672:0:6553:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787359897.049676:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359897.049678:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359897.049680:0:6553:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787359897.049682:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359897.049686:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359897.049688:0:6553:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787359897.049692:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787359897.049741:0:6553:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787359897.049799:0:6553:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1b5aa86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6553:1874182595937536:0@lo:502: 00000100:00100000:1.0:1787359897.049863:0:6553:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.049916:0:6553:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6728450 going to sleep for 11 seconds 00000100:00100000:0.0:1787359897.050065:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937536 00000100:00100000:0.0:1787359897.050073:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937536 00000100:00100000:0.0:1787359897.050111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359897.050124:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d13b381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6553:x1874182595937536:12345-0@lo:502: 00000100:00100000:0.0:1787359897.050306:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d13b381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6553:x1874182595937536:12345-0@lo:502: Request processed in 187us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.050314:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359897.050794:0:6553:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1b5aa86 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6553:1874182595937536:0@lo:502: 00000020:01000000:3.0:1787359897.050822:0:6553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359897.050827:0:6553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359897.050829:0:6553:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787359897.050833:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787359897.051013:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787359897.051032:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787359897.051263:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.051274:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359897.051281:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a0ffaa800 from 1 10000000:01000000:1.0:1787359897.051284:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787359897.051320:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.051327:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.051335:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.051350:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937664:0@lo:101: 00000100:00100000:1.0:1787359897.051388:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.051420:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:2.0:1787359897.051454:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937664 00000100:00100000:2.0:1787359897.051460:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937664 00000100:00100000:2.0:1787359897.051494:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359897.051503:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3ecb038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6508:x1874182595937664:12345-0@lo:101: 00010000:00010000:2.0:1787359897.051512:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359897.051523:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fb2b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.051542:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.051550:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.051558:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bf8e8c9, rc 0) 00000100:00100000:2.0:1787359897.051597:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3ecb038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:6508:x1874182595937664:12345-0@lo:101: Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359897.051603:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787359897.051658:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937664:0@lo:101: 00010000:00010000:1.0:1787359897.051669:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.051690:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.052485:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937792:0@lo:256: 00000100:00100000:1.0:1787359897.052528:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.052553:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:2.0:1787359897.052686:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937792 00000100:00100000:2.0:1787359897.052692:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937792 00000100:00100000:2.0:1787359897.052759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359897.052766:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002779fc6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:6508:x1874182595937792:12345-0@lo:256: 20000000:01000000:2.0:1787359897.052779:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787359897.052784:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787359897.052845:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002779fc6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:6508:x1874182595937792:12345-0@lo:256: Request processed in 80us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359897.052852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359897.052954:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937792:0@lo:256: 10000000:01000000:1.0:1787359897.053731:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787359897.053787:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.053797:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359897.053805:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a0ffaa800 from 1 10000000:01000000:1.0:1787359897.053808:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359897.053834:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.053841:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.053848:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.053863:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937920:0@lo:101: 00000100:00100000:1.0:1787359897.053902:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.054191:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:0.0:1787359897.054325:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595937920 00000100:00100000:0.0:1787359897.054331:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595937920 00000100:00100000:0.0:1787359897.054361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359897.054367:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc58018b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:6508:x1874182595937920:12345-0@lo:101: 00010000:00010000:0.0:1787359897.054376:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359897.054389:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fb39 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359897.054407:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359897.054428:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359897.054436:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000041896b4, rc 0) 00000100:00100000:0.0:1787359897.055777:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc58018b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595937920:12345-0@lo:101: Request processed in 1404us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.055788:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359897.056099:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595937920:0@lo:101: 00010000:00010000:1.0:1787359897.056174:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.056185:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.056402:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938048:0@lo:501: 00000100:00100000:1.0:1787359897.056445:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.056500:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:0.0:1787359897.056538:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938048 00000100:00100000:0.0:1787359897.056543:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938048 00000100:00100000:0.0:1787359897.056664:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359897.056672:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037f58a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595938048:12345-0@lo:501: 00000100:00100000:0.0:1787359897.056810:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037f58a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595938048:12345-0@lo:501: Request processed in 139us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.056817:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787359897.056869:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938048:0@lo:501: 00000100:00100000:1.0:1787359897.056892:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938176:0@lo:503: 00000100:00100000:1.0:1787359897.056932:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.057016:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:2.0:1787359897.057174:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938176 00000100:00100000:2.0:1787359897.057179:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938176 00000100:00100000:2.0:1787359897.057198:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787359897.057203:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c9b17d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595938176:12345-0@lo:503: 00000040:00080000:2.0:1787359897.057260:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787359897.057294:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c9b17d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595938176:12345-0@lo:503: Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359897.057300:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787359897.057442:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938176:0@lo:503: 00000040:00080000:0.0:1787359897.058784:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787359897.058983:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787359897.059004:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787359897.059114:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.059135:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359897.059184:0:6508:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787359897.059187:0:6508:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a0ffaa800 10000000:01000000:1.0:1787359897.059190:0:6508:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a0ffaa800 10000000:01000000:1.0:1787359897.059194:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787359897.059210:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a0ffaa800 from 1 10000000:01000000:1.0:1787359897.059212:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787359897.059270:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.059278:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.059286:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.059466:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938304:0@lo:101: 00000100:00100000:1.0:1787359897.059526:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.059562:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdc61b87 going to sleep for 11 seconds 00000100:00100000:2.0:1787359897.059690:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938304 00000100:00100000:2.0:1787359897.059697:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938304 00000100:00100000:2.0:1787359897.059771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359897.059780:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abfdcfb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6508:x1874182595938304:12345-0@lo:101: 00010000:00010000:2.0:1787359897.059792:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359897.059804:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fb47 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.059826:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.059834:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359897.059852:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004026a783, rc 0) 00000100:00100000:2.0:1787359897.059894:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abfdcfb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595938304:12345-0@lo:101: Request processed in 116us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359897.059901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787359897.059998:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938304:0@lo:101: 00010000:00010000:1.0:1787359897.060011:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.060019:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.060079:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938432:0@lo:501: 00000100:00100000:1.0:1787359897.060106:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.060471:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdc61b87 going to sleep for 11 seconds 00000100:00100000:0.0:1787359897.060556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938432 00000100:00100000:0.0:1787359897.060563:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938432 00000100:00100000:0.0:1787359897.060600:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359897.060606:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036b3cd6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595938432:12345-0@lo:501: 00000100:00100000:0.0:1787359897.060720:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036b3cd6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595938432:12345-0@lo:501: Request processed in 114us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.060727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787359897.060791:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938432:0@lo:501: 00000100:00100000:1.0:1787359897.060817:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938560:0@lo:503: 00000100:00100000:1.0:1787359897.060858:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.060878:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdc61b87 going to sleep for 11 seconds 00000100:00100000:0.0:1787359897.060987:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938560 00000100:00100000:0.0:1787359897.060991:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938560 00000100:00100000:0.0:1787359897.061009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787359897.061014:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b6a7ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595938560:12345-0@lo:503: 00000100:00100000:0.0:1787359897.061109:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b6a7ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595938560:12345-0@lo:503: Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.061115:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359897.061265:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595938560:0@lo:503: 00000100:00100000:0.0:1787359897.062083:0:6558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005bd4a65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6558:1874182595938688:0@lo:502: 00000100:00100000:0.0:1787359897.062276:0:6558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359897.062313:0:6558:0:(client.c:2715:ptlrpc_set_wait()) set 00000000834ea603 going to sleep for 11 seconds 00000100:00100000:2.0:1787359897.062447:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938688 00000100:00100000:2.0:1787359897.062453:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938688 00000100:00100000:2.0:1787359897.062491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787359897.062499:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e958593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6558:x1874182595938688:12345-0@lo:502: 00000100:00100000:2.0:1787359897.062603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e958593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6558:x1874182595938688:12345-0@lo:502: Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359897.062610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787359897.062718:0:6558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005bd4a65 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6558:1874182595938688:0@lo:502: 00000020:01000004:0.0:1787359897.062779:0:6558:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787359897.062799:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000aef1ccbf) 00000020:00000080:0.0:1787359897.062817:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787359897.062884:0:6558:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008bc5d4fd from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787359897.062888:0:6558:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008bc5d4fd from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787359897.062891:0:6558:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008bc5d4fd 4 00010000:00080000:0.0:1787359897.062920:0:6558:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006dc7bf38@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787359897.066208:0:6558:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787359897.068441:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787359897.068500:0:6558:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787359897.068512:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x359a4e2aee71fb5c 00000100:00080000:1.0:1787359897.068521:0:6558:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359897.068526:0:6558:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006dc7bf38 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787359897.068554:0:6558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000051e60403 x1874182595938816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787359897.068616:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182595938816:0@lo:38: 00000100:00100000:0.0:1787359897.068684:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787359897.068747:0:6558:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787359897.072401:0:6558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6558:1874182595938944:0@lo:502: 00000100:00100000:1.0:1787359897.072498:0:6558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.072541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938944 00000100:00100000:1.0:1787359897.072548:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938944 00000100:00100000:1.0:1787359897.072589:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359897.072598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e64943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6558:x1874182595938944:12345-0@lo:502: 00000100:00100000:1.0:1787359897.072730:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e64943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6558:x1874182595938944:12345-0@lo:502: Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359897.072739:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359897.072868:0:6558:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7c527c6 going to sleep for 11 seconds 00000100:00100000:1.0:1787359897.072889:0:6558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6558:1874182595938944:0@lo:502: 00000040:00080000:1.0:1787359897.072914:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787359897.072997:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787359897.073017:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787359897.073028:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.073047:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787359897.073090:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787359897.073092:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787359897.073094:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359897.073095:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359897.073096:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359897.073097:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359897.073099:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787359897.073100:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787359897.073101:0:6508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359897.073103:0:6508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359897.073105:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359897.073106:0:6508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787359897.073109:0:6508:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787359897.073112:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787359897.073113:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787359897.073115:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359897.073115:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359897.073116:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359897.073258:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359897.073259:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787359897.073260:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787359897.073261:0:6508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359897.073262:0:6508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359897.073263:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359897.073264:0:6508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787359897.073278:0:6508:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787359897.073288:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595939072:0@lo:253: 00000100:00100000:1.0:1787359897.073331:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.073344:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042cec96e going to sleep for 11 seconds 00000100:00100000:3.0:1787359897.073560:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939072 00000100:00100000:3.0:1787359897.073567:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939072 00000100:00100000:3.0:1787359897.073606:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787359897.073613:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054b58104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595939072:12345-0@lo:253: 20000000:01000000:3.0:1787359897.073634:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787359897.073647:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787359897.075093:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595938816 00000100:00100000:0.0:1787359897.075103:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595938816 00000100:00100000:0.0:1787359897.076306:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359897.076316:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005bd4a65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182595938816:12345-0@lo:38: 00000100:00100000:0.0:1787359897.076403:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005bd4a65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182595938816:12345-0@lo:38: Request processed in 87us (7720us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787359897.076409:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359897.076458:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787359897.076466:0:3657:0:(import.c:65:import_set_state_nolock()) 000000006dc7bf38 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787359897.076469:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787359897.076472:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182595938816:0@lo:38: 20000000:01000000:0.0:1787359897.083106:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787359897.083165:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787359897.085179:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054b58104 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6508:x1874182595939072:12345-0@lo:253: Request processed in 11560us (11841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359897.085193:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787359897.085279:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6508:1874182595939072:0@lo:253: 10000000:01000000:2.0:1787359897.085293:0:6508:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787359897.085297:0:6508:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787359897.085298:0:6508:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787359897.085299:0:6508:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359897.085300:0:6508:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359897.085301:0:6508:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359897.085685:0:6508:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359897.085689:0:6508:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787359897.085691:0:6508:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787359897.085692:0:6508:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359897.085693:0:6508:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359897.085695:0:6508:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359897.085696:0:6508:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787359897.085710:0:6508:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787359897.087922:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787359897.087930:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787359897.087952:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.087995:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.088002:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.088040:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359897.088055:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 11 pid: 6526 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359897.088069:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd3d4adc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595939200:0@lo:104: 00000100:00100000:1.0:1787359897.088126:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359897.088174:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6728450 going to sleep for 11 seconds 00000100:00100000:3.0:1787359897.088336:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939200 00000100:00100000:3.0:1787359897.088344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939200 00000100:00100000:3.0:1787359897.088389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359897.088397:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012dbb543 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595939200:12345-0@lo:104: 00010000:00010000:3.0:1787359897.088408:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.088465:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359897.088470:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012dbb543 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595939200:12345-0@lo:104: Request processed in 74us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359897.088477:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359897.088478:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd3d4adc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595939200:0@lo:104: 00010000:00010000:0.0:1787359897.088495:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089388:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787359897.089407:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089415:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc24d75a already unused, calling callback (0000000010c5082c) 10000000:00010000:3.0:1787359897.089418:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089424:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359897.089430:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359897.089434:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359897.089489:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089496:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359897.089517:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089524:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000fc24d75a/0x359a4e2aee71fb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb32 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089540:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359897.089542:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359897.089544:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359897.089601:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000864aaff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595939328:0@lo:103: 00000100:00100000:0.0:1787359897.089642:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359897.089705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939328 00000100:00100000:3.0:1787359897.089711:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939328 00010000:00010000:3.0:1787359897.089730:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 12 pid: 6526 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359897.089770:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359897.089778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006591f5b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:3659:x1874182595939328:12345-0@lo:103: 00010000:00010000:3.0:1787359897.089788:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359897.089792:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 12 pid: 6526 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089801:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 12 pid: 6526 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089813:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005bf8e8c9/0x359a4e2aee71fb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fb2b expref: 12 pid: 6526 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089825:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.089831:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787359897.090114:0:6516:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002184626s 00010000:00010000:3.0:1787359897.090126:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090133:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090138:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090142:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090152:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000837f24bd already unused, calling callback (000000006ae1db34) 00010000:00010000:3.0:1787359897.090211:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090218:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090254:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359897.090264:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359897.090266:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359897.090271:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359897.090276:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359897.090303:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006591f5b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:3659:x1874182595939328:12345-0@lo:103: Request processed in 526us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359897.090310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359897.090325:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000864aaff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595939328:0@lo:103: 00080000:10000000:2.0:1787359897.096019:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.096208:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787359897.096445:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.096583:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787359897.096776:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.096963:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787359897.097751:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.098005:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787359897.098538:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.099396:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787359897.099586:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1787359897.100852:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1787359897.106312:0:6508:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787359897.116770:0:6508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787359897.116848:0:6563:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787359897.116852:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787359897.117337:0:6564:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787359897.119103:0:6508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787359897.119212:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787359897.120004:0:6508:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787359897.120016:0:6508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787359897.120147:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359897.121686:0:6508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787359897.123549:0:6508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787359897.123620:0:6508:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787359897.124103:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787359897.124529:0:6508:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1787359897.124699:0:6564:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1787359897.128391:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787359897.128655:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787359897.129064:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787359897.129471:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787359897.129586:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787359897.129695:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787359897.129996:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787359897.130143:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787359897.130283:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787359897.130571:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787359897.130689:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787359897.130795:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787359897.131060:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787359897.131595:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787359897.131748:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787359897.132020:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787359897.132725:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787359897.132936:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787359897.133083:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:3.0:1787359897.133661:0:6564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787359897.133732:0:6564:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787359897.133737:0:6564:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1787359897.134213:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787359897.135292:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787359897.135507:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787359897.135657:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787359897.135796:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787359897.136527:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787359897.136677:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787359897.136815:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787359897.137083:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787359897.137383:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787359897.137596:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787359897.137734:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787359897.141356:0:6508:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787359897.141689:0:6508:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787359897.150289:0:6508:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787359897.150327:0:6508:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4f7819bf988 00100000:10000000:2.0:1787359897.150334:0:6508:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787359897.154066:0:6508:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787359897.154081:0:6508:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787359897.154100:0:6508:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787359897.154139:0:6508:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787359897.156397:0:6508:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359897.156627:0:6508:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787359897.721535:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359898.746598:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359899.778825:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359900.796101:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359901.148351:0:6809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787359901.818116:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787359902.016456:0:6861:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787359902.018364:0:6861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:0.0:1787359902.457604:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787359902.457613:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787359902.457616:0:36:0:(import.c:65:import_set_state_nolock()) 000000006dc7bf38 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787359902.457627:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006dc7bf38 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787359902.457648:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004d761135 x1874182595939584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787359902.457683:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182595939584:0@lo:38: 00000100:00100000:0.0:1787359902.457746:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359902.458863:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939584 00000100:00100000:2.0:1787359902.458873:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939584 00000100:00100000:2.0:1787359902.458913:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359902.458919:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000285e0195 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182595939584:12345-0@lo:38: 00010000:00080000:2.0:1787359902.458951:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:2.0:1787359902.458988:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x359a4e2aee71fb6a 00000004:00100000:2.0:1787359902.459032:0:6533:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1787359902.462737:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087109271 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595939456:0@lo:400: 00000100:00100000:3.0:1787359902.463083:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359902.463184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939456 00000100:00100000:1.0:1787359902.463192:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939456 00000100:00100000:1.0:1787359902.463273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787359902.463290:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d107c08c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:3660:x1874182595939456:12345-0@lo:400: 00000100:00100000:1.0:1787359902.463341:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d107c08c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:3660:x1874182595939456:12345-0@lo:400: Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359902.463349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787359902.463497:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087109271 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595939456:0@lo:400: 00000100:00080000:2.0:1787359902.465495:0:6533:0:(import.c:65:import_set_state_nolock()) 00000000a06b58ab : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359902.465587:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000285e0195 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874182595939584:12345-0@lo:38: Request processed in 6665us (7839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359902.465599:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359902.466324:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004d761135 x1874182595939584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787359902.466343:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787359902.466352:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787359902.466356:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787359902.466359:0:3657:0:(import.c:65:import_set_state_nolock()) 000000006dc7bf38 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787359902.466366:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182595939584:0@lo:38: 00010000:00010000:2.0:1787359902.842957:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359903.870456:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787359903.996102:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787359903.996112:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a0ffaa800 from 3 10000000:01000000:1.0:1787359903.996118:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787359903.996159:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359903.996179:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359903.996190:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359903.996214:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595939712:0@lo:101: 00000100:00100000:1.0:1787359903.996346:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359903.996392:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcb831d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787359903.996469:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939712 00000100:00100000:0.0:1787359903.996478:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939712 00000100:00100000:0.0:1787359903.996535:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787359903.996544:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006edc0d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:6528:x1874182595939712:12345-0@lo:101: 00010000:00010000:0.0:1787359903.996557:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359903.996571:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fb71 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359903.996592:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359903.996609:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359903.996617:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2355649, rc 0) 00000100:00100000:0.0:1787359903.996659:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006edc0d4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6528:x1874182595939712:12345-0@lo:101: Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359903.996666:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787359903.996767:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595939712:0@lo:101: 00010000:00010000:1.0:1787359903.996785:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359903.996794:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359903.996843:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595939840:0@lo:256: 00000100:00100000:1.0:1787359903.996878:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359903.996901:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bcb831d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787359903.997090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939840 00000100:00100000:0.0:1787359903.997095:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939840 00000100:00100000:0.0:1787359903.997166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787359903.997173:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000782ebd4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6528:x1874182595939840:12345-0@lo:256: 20000000:01000000:0.0:1787359903.997187:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787359903.997201:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787359903.997204:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787359903.997326:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000782ebd4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:6528:x1874182595939840:12345-0@lo:256: Request processed in 153us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359903.997334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787359903.999699:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595939840:0@lo:256: 10000000:01000000:1.0:1787359903.999761:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787359903.999771:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359903.999781:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1787359904.734989:0:6962:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787359904.735179:0:6962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787359904.889398:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359905.913443:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359906.937733:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359907.579128:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595939968:0@lo:400: 00000100:00100000:0.0:1787359907.579243:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359907.579441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595939968 00000100:00100000:1.0:1787359907.579449:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595939968 00000100:00100000:1.0:1787359907.579504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359907.579512:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c768d1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:3661:x1874182595939968:12345-0@lo:400: 00000100:00100000:1.0:1787359907.584373:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c768d1c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:3661:x1874182595939968:12345-0@lo:400: Request processed in 4850us (5119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359907.584394:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359907.585552:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595940096:0@lo:400: 00000100:00100000:1.0:1787359907.585642:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359907.586601:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595939968:0@lo:400: 00000100:00100000:2.0:1787359907.587640:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940096 00000100:00100000:2.0:1787359907.587656:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940096 00000100:00100000:2.0:1787359907.587729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359907.587741:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9a39605 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595940096:12345-0@lo:400: 00000100:00100000:2.0:1787359907.587867:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9a39605 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595940096:12345-0@lo:400: Request processed in 128us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359907.587876:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359907.588039:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f89e33b7 x1874182595940096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359907.588055:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595940096:0@lo:400: 00010000:00010000:2.0:1787359907.969261:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359908.987127:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359910.010737:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359911.036360:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359912.059317:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359912.698466:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595940224:0@lo:400: 00000100:00100000:0.0:1787359912.698562:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359912.698650:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087109271 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595940352:0@lo:400: 00000100:00100000:1.0:1787359912.698666:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940224 00000100:00100000:1.0:1787359912.698675:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940224 00000100:00100000:0.0:1787359912.698688:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359912.698726:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940352 00000100:00100000:1.0:1787359912.698728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359912.698730:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940352 00000100:00100000:1.0:1787359912.698737:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001be0efff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:3659:x1874182595940224:12345-0@lo:400: 00000100:00100000:0.0:1787359912.698759:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359912.698765:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061905433 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595940352:12345-0@lo:400: 00000100:00100000:1.0:1787359912.698797:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001be0efff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:3659:x1874182595940224:12345-0@lo:400: Request processed in 60us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359912.698797:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061905433 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595940352:12345-0@lo:400: Request processed in 31us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359912.698805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359912.698805:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359912.698849:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000087109271 x1874182595940352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359912.698864:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087109271 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595940352:0@lo:400: 00000100:00100000:0.0:1787359912.698902:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595940224:0@lo:400: 00010000:00010000:0.0:1787359913.081444:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359914.105379:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359915.129402:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787359915.851220:0:7461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787359915.851471:0:7461:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787359915.851473:0:7461:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787359915.851619:0:7461:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ccb2bd57 00000020:01000004:2.0:1787359915.851633:0:7461:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787359915.851644:0:7461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787359915.851656:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f2a815ce) 00000020:00000080:2.0:1787359915.851671:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787359915.904632:0:7461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787359915.904921:0:7461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787359915.921669:0:7461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787359915.921890:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787359915.921899:0:7461:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787359915.921910:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71fb86 00000020:01000004:1.0:1787359915.921915:0:7461:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787359915.921936:0:7461:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787359915.921939:0:7461:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787359915.921944:0:7461:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787359915.921966:0:7461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787359915.921974:0:7461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787359915.952962:0:7461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787359915.952996:0:7461:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1787359915.953000:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787359915.953002:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787359915.953003:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359915.953005:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359915.953006:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359915.953007:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359915.953008:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359915.953010:0:7461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359915.953011:0:7461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359915.953012:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359915.953013:0:7461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359915.953016:0:7461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1787359915.953018:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359915.953022:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787359915.953023:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359915.953025:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359915.953025:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359915.953027:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359915.953027:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359915.953028:0:7461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359915.953029:0:7461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359915.953030:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359915.953031:0:7461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359915.953053:0:7461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787359915.953067:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595940480:0@lo:253: 00000100:00100000:0.0:1787359915.953145:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359915.953211:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940480 00000100:00100000:1.0:1787359915.953247:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940480 00000100:00100000:1.0:1787359915.953299:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359915.953309:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057a208a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595940480:12345-0@lo:253: 00000100:00100000:0.0:1787359915.953312:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000707dd593 going to sleep for 11 seconds 20000000:01000000:1.0:1787359915.953340:0:6526:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787359915.953345:0:6526:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1787359915.953350:0:6526:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1787359915.953353:0:6526:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1787359915.953381:0:6526:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1787359915.953528:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787359915.953624:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787359915.953641:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787359915.953656:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787359915.953670:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787359915.953683:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787359915.953725:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1787359915.953732:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1787359915.953744:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1787359915.953748:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1787359915.953759:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1787359915.953763:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1787359915.953773:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787359915.953785:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787359915.953886:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1787359915.953895:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:1.0:1787359915.953907:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1787359915.953912:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787359915.953922:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1787359915.953927:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:1.0:1787359915.953937:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1787359915.953948:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787359915.953960:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787359915.953972:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787359915.953980:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787359915.954043:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1787359915.954050:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1787359915.954060:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787359915.954073:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787359915.954087:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1787359915.954093:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1787359915.954328:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787359915.954356:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787359915.954362:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1787359915.954382:0:6526:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787359915.954389:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1787359915.954743:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787359915.954924:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787359915.954940:0:6526:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:1.0:1787359915.954941:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:1.0:1787359915.954954:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787359915.954958:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787359915.954970:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787359915.954975:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:1.0:1787359915.954988:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787359915.954995:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1787359915.955007:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1787359915.955027:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1787359915.955067:0:6526:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1787359915.955074:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1787359915.956404:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787359915.956582:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787359915.956602:0:6526:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.111@tcp for mdt 20000000:01000000:2.0:1787359915.956604:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787359915.956617:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787359915.956622:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787359915.956633:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787359915.956637:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1787359915.956647:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787359915.956652:0:6526:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787359915.956662:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787359915.956688:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787359915.956705:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787359915.956708:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787359915.956711:0:6526:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787359915.956754:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787359915.956756:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359915.956993:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359915.957011:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359915.957023:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787359915.957301:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1787359915.957323:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1787359915.957340:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1787359915.957350:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787359915.957352:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787359915.960542:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787359915.960582:0:7470:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787359915.960595:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1787359915.961303:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1787359915.961330:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1787359915.961366:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1787359915.961378:0:6526:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787359915.961380:0:6526:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787359915.961664:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787359915.961679:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787359915.961691:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787359915.961826:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787359915.961842:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787359915.961864:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787359915.961888:0:6526:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359915.961891:0:6526:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359915.961896:0:6526:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787359915.961901:0:6526:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787359915.962122:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787359915.962367:0:6526:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787359915.968518:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787359915.968558:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968576:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968584:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968589:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968595:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968630:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968657:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 12 pid: 6524 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359915.968670:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec41c1f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940608:0@lo:104: 00000100:00100000:2.0:1787359915.968734:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359915.968788:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968795:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 12 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359915.968803:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940736:0@lo:104: 00000100:00100000:2.0:1787359915.968820:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359915.968850:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.968857:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 12 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359915.968864:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa8becf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940864:0@lo:104: 00000100:00100000:2.0:1787359915.968896:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359915.968907:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adea0570 going to sleep for 11 seconds 00000100:00100000:0.0:1787359915.968914:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940608 00000100:00100000:0.0:1787359915.968923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940608 00000100:00100000:0.0:1787359915.968958:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940736 00000100:00100000:0.0:1787359915.968960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940736 00000100:00100000:1.0:1787359915.968962:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940864 00000100:00100000:1.0:1787359915.968969:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940864 00000100:00100000:0.0:1787359915.968975:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359915.968985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006af49ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6526:x1874182595940608:12345-0@lo:104: 00010000:00010000:0.0:1787359915.968996:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969057:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359915.969063:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006af49ac9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6526:x1874182595940608:12345-0@lo:104: Request processed in 81us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.969071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359915.969081:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec41c1f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940608:0@lo:104: 00000100:00100000:0.0:1787359915.969090:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359915.969097:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfcf5e9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6526:x1874182595940736:12345-0@lo:104: 00010000:00010000:0.0:1787359915.969123:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969125:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359915.969132:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969141:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d9ebdbb already unused, calling callback (0000000010c5082c) 10000000:00010000:1.0:1787359915.969144:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969152:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359915.969159:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969164:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1787359915.969165:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787359915.969171:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfcf5e9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6526:x1874182595940736:12345-0@lo:104: Request processed in 74us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.969178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359915.969191:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787359915.969194:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.969199:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009bef983 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6526:x1874182595940864:12345-0@lo:104: 00010000:00010000:1.0:1787359915.969208:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359915.969209:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969245:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969253:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000004d9ebdbb/0x359a4e2aee71fb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb4e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969258:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787359915.969265:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009bef983 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6526:x1874182595940864:12345-0@lo:104: Request processed in 69us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.969276:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787359915.969282:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787359915.969285:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969292:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ec85f0bb already unused, calling callback (0000000010c5082c) 00010000:00010000:0.0:1787359915.969293:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787359915.969294:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969302:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359915.969308:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359915.969314:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359915.969327:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969332:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359915.969355:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969361:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000ec85f0bb/0x359a4e2aee71fad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fade expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.969370:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359915.969371:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359915.969373:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359915.969378:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d3cab92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595941120:0@lo:103: 00000100:00100000:1.0:1787359915.969393:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595940992:0@lo:103: 00000100:00100000:0.0:1787359915.969406:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359915.969434:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.969453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941120 00000100:00100000:0.0:1787359915.969457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941120 00010000:00010000:0.0:1787359915.969484:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 13 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.969507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595940992 00000100:00100000:0.0:1787359915.969510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595940992 00010000:00010000:0.0:1787359915.969518:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 14 pid: 6524 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.969541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359915.969545:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087109271 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3658:x1874182595941120:12345-0@lo:103: 00010000:00010000:0.0:1787359915.969554:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359915.969557:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 14 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969565:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 14 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969579:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359915.969583:0:6518:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787359915.969592:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787359915.969606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087109271 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3658:x1874182595941120:12345-0@lo:103: Request processed in 60us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.969612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359915.969625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359915.969630:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000546b553d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:3661:x1874182595940992:12345-0@lo:103: 00010000:00010000:0.0:1787359915.969636:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359915.969640:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 13 pid: 6524 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969650:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 13 pid: 6524 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969660:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004026a783/0x359a4e2aee71fb4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fb47 expref: 13 pid: 6524 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.969664:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fad7 expref: 13 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.969672:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359915.969679:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940736:0@lo:104: 00000100:00100000:2.0:1787359915.969690:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa8becf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6526:1874182595940864:0@lo:104: 00000100:00100000:0.0:1787359915.969698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000546b553d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:3661:x1874182595940992:12345-0@lo:103: Request processed in 67us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.969714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787359915.969717:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.969741:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d3cab92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595941120:0@lo:103: 00000100:00100000:1.0:1787359915.969931:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595940992:0@lo:103: 00010000:00010000:1.0:1787359915.970783:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359915.970785:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359915.970787:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359915.970804:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.970813:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071af64f6 already unused, calling callback (0000000010c5082c) 10000000:00010000:3.0:1787359915.970815:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.970822:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359915.970828:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359915.970834:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359915.970898:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.970905:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359915.970930:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.970936:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fac2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.970948:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359915.970950:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359915.970951:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359915.970979:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359915.970990:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595941248:0@lo:103: 00000100:00100000:2.0:1787359915.971028:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359915.971092:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941248 00000100:00100000:3.0:1787359915.971097:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941248 00010000:00010000:3.0:1787359915.971123:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 11 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359915.971160:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359915.971167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aa8becf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:3658:x1874182595941248:12345-0@lo:103: 00010000:00010000:3.0:1787359915.971176:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359915.971180:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 11 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971188:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 11 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971198:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9471538/0x359a4e2aee71fac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fabb expref: 11 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971208:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971214:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971246:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971252:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971257:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971263:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971277:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a4ce2c1 already unused, calling callback (000000006ae1db34) 00010000:00010000:3.0:1787359915.971280:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971286:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971296:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359915.971305:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359915.971333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aa8becf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:3658:x1874182595941248:12345-0@lo:103: Request processed in 168us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359915.971340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359915.971368:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595941248:0@lo:103: 00010000:00010000:2.0:1787359915.971504:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.971512:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.971526:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a4ce2c1/0x359a4e2aee71fb8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787359915.971539:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787359915.973674:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057a208a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:7461:x1874182595940480:12345-0@lo:253: Request processed in 20362us (20524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359915.973686:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787359915.973750:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595940480:0@lo:253: 10000000:01000000:0.0:1787359915.973762:0:7461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787359915.973765:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787359915.973768:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787359915.973769:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359915.973770:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787359915.973772:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359915.973773:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359915.973774:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359915.973775:0:7461:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787359915.973777:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359915.973778:0:7461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787359915.973792:0:7461:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ccb2bd57 from lustre-MDT0001 10000000:01000000:0.0:1787359915.973816:0:7461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787359915.973819:0:7461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787359915.973824:0:7461:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a3bac8000 local copy 10000000:01000000:0.0:1787359915.973827:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359915.973853:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.973861:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.973868:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.973897:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941376:0@lo:101: 00000100:00100000:0.0:1787359915.973926:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.973985:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000476540d7 going to sleep for 11 seconds 00000100:00100000:1.0:1787359915.974025:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941376 00000100:00100000:1.0:1787359915.974030:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941376 00000100:00100000:1.0:1787359915.974092:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359915.974141:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c2d5396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:7461:x1874182595941376:12345-0@lo:101: 00010000:00010000:1.0:1787359915.974152:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359915.974163:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fb94 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.974181:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fb94 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.974189:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb94 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.974197:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000837f24bd, rc 0) 00000100:00100000:1.0:1787359915.974256:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c2d5396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:7461:x1874182595941376:12345-0@lo:101: Request processed in 157us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359915.974262:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359915.974319:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941376:0@lo:101: 00010000:00010000:0.0:1787359915.974329:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974336:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.974402:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941504:0@lo:501: 00000100:00100000:0.0:1787359915.974424:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.974620:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000476540d7 going to sleep for 11 seconds 00000100:00100000:2.0:1787359915.974690:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941504 00000100:00100000:2.0:1787359915.974695:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941504 00000100:00100000:2.0:1787359915.974715:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787359915.974720:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f24b9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:7461:x1874182595941504:12345-0@lo:501: 00000100:00100000:2.0:1787359915.974776:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f24b9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:7461:x1874182595941504:12345-0@lo:501: Request processed in 56us (351us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359915.974782:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359915.974835:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941504:0@lo:501: 10000000:01000000:0.0:1787359915.974846:0:7461:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787359915.974860:0:7461:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787359915.974863:0:7461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974881:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974888:0:7461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974907:0:7461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787359915.974928:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a10f4d000 10000000:01000000:0.0:1787359915.974932:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787359915.974936:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff998a3bac8000 10000000:01000000:0.0:1787359915.974938:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787359915.974941:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff998a3bac8000 from 1 10000000:01000000:0.0:1787359915.974949:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787359915.974961:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974968:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.974975:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.974984:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941632:0@lo:101: 00000100:00100000:0.0:1787359915.975006:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.975015:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000124f88fa going to sleep for 11 seconds 00010000:00010000:2.0:1787359915.975051:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359915.975055:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975072:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cd05c350 already unused, calling callback (0000000010c5082c) 10000000:00010000:2.0:1787359915.975074:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975081:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359915.975087:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359915.975092:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359915.975191:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975198:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359915.975220:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975258:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000cd05c350/0x359a4e2aee71fb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fb9b expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975272:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359915.975273:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359915.975275:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359915.975281:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359915.975290:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595941760:0@lo:103: 00000100:00100000:2.0:1787359915.975313:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359915.975342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941760 00000100:00100000:2.0:1787359915.975346:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941760 00000100:00100000:2.0:1787359915.975377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359915.975382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec41c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:3661:x1874182595941760:12345-0@lo:103: 00010000:00010000:2.0:1787359915.975390:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359915.975399:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000837f24bd/0x359a4e2aee71fb9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fb94 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975410:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359915.975433:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec41c1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:3661:x1874182595941760:12345-0@lo:103: Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359915.975439:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359915.975459:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595941760:0@lo:103: 00000100:00100000:2.0:1787359915.975472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941632 00000100:00100000:2.0:1787359915.975475:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941632 00000100:00100000:2.0:1787359915.975487:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787359915.975492:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464408ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:7461:x1874182595941632:12345-0@lo:101: 00010000:00010000:2.0:1787359915.975498:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359915.975505:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fba9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fba2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975630:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fba9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fba2 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975639:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000691c3b37/0x359a4e2aee71fba9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fba2 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359915.975645:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000691c3b37, rc 0) 00000100:00100000:2.0:1787359915.975715:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464408ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:7461:x1874182595941632:12345-0@lo:101: Request processed in 223us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359915.975729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787359915.975848:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941632:0@lo:101: 00010000:00010000:0.0:1787359915.975858:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.975864:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359915.975888:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787359915.975902:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.975909:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000d5e1b72b/0x359a4e2aee71fba2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359915.975916:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998a10f4d000 10000000:01000000:0.0:1787359915.975920:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787359915.975923:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998a10f4d000 from 1 10000000:01000000:0.0:1787359915.975929:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787359915.975941:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.975946:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.975953:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.975963:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941888:0@lo:101: 00000100:00100000:0.0:1787359915.975985:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.976000:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000124f88fa going to sleep for 11 seconds 00000100:00100000:1.0:1787359915.976053:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595941888 00000100:00100000:1.0:1787359915.976057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595941888 00000100:00100000:1.0:1787359915.976074:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787359915.976079:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac07317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+10:7461:x1874182595941888:12345-0@lo:101: 00010000:00010000:1.0:1787359915.976093:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359915.976099:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d9ebdbb/0x359a4e2aee71fbb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fbb0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976111:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d9ebdbb/0x359a4e2aee71fbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fbb0 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976117:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d9ebdbb/0x359a4e2aee71fbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fbb0 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976124:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d9ebdbb, rc 0) 00000100:00100000:1.0:1787359915.976153:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac07317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:7461:x1874182595941888:12345-0@lo:101: Request processed in 74us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359915.976159:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359915.976257:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595941888:0@lo:101: 00010000:00010000:0.0:1787359915.976266:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.976272:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359915.976281:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787359915.976373:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.976381:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000009bdd6b10/0x359a4e2aee71fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359915.976387:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787359915.976390:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359915.976393:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998a10f4d000 10000000:01000000:0.0:1787359915.976400:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787359915.976403:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787359915.976405:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787359915.976416:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.976421:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.976428:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.976438:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942016:0@lo:101: 00000100:00100000:0.0:1787359915.976459:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.976477:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000124f88fa going to sleep for 11 seconds 00000100:00100000:1.0:1787359915.976532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942016 00000100:00100000:1.0:1787359915.976536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942016 00000100:00100000:1.0:1787359915.976562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359915.976568:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4112af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+11:7461:x1874182595942016:12345-0@lo:101: 00010000:00010000:1.0:1787359915.976576:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359915.976583:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc24d75a/0x359a4e2aee71fbc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fbbe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976594:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc24d75a/0x359a4e2aee71fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976601:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc24d75a/0x359a4e2aee71fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359915.976606:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc24d75a, rc 0) 00000100:00100000:1.0:1787359915.976633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4112af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942016:12345-0@lo:101: Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359915.976638:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787359915.976736:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942016:0@lo:101: 00010000:00010000:0.0:1787359915.976745:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359915.976751:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359915.976810:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942144:0@lo:501: 00000100:00100000:0.0:1787359915.976832:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.976850:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000124f88fa going to sleep for 11 seconds 00000100:00100000:1.0:1787359915.976894:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942144 00000100:00100000:1.0:1787359915.976898:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942144 00000100:00100000:1.0:1787359915.976924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787359915.976929:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4064d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942144:12345-0@lo:501: 00000100:00100000:1.0:1787359915.977002:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4064d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942144:12345-0@lo:501: Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359915.977009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359915.977062:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942144:0@lo:501: 00000100:00100000:0.0:1787359915.977084:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942272:0@lo:503: 00000100:00100000:0.0:1787359915.977117:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359915.977141:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000124f88fa going to sleep for 11 seconds 00000100:00100000:1.0:1787359915.977202:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942272 00000100:00100000:1.0:1787359915.977205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942272 00000100:00100000:1.0:1787359915.977259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359915.977265:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079dd3750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942272:12345-0@lo:503: 00000100:00100000:1.0:1787359915.977336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079dd3750 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942272:12345-0@lo:503: Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359915.977343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359915.977385:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d761135 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942272:0@lo:503: 00000040:00080000:1.0:1787359915.977708:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359915.977760:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942400:0@lo:502: 00000100:00100000:1.0:1787359915.977789:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359915.977816:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bb6625f going to sleep for 11 seconds 00000100:00100000:0.0:1787359915.977853:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942400 00000100:00100000:0.0:1787359915.977857:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942400 00000100:00100000:0.0:1787359915.977893:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359915.977899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004374f423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942400:12345-0@lo:502: 00000100:00100000:0.0:1787359915.977972:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004374f423 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942400:12345-0@lo:502: Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.977978:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787359915.978102:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942400:0@lo:502: 00000040:00080000:1.0:1787359915.978345:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787359915.978368:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787359915.978390:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787359915.978402:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787359915.978420:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787359915.978431:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787359915.978442:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787359915.978452:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787359915.978463:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787359915.978474:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787359915.978484:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787359915.978495:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787359915.978505:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787359915.978578:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787359915.978595:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787359915.978606:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787359915.978616:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787359915.978626:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787359915.978648:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787359915.978660:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787359915.978670:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787359915.978682:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787359915.978692:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787359915.978709:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942528:0@lo:502: 00000100:00100000:1.0:1787359915.978740:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359915.978796:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bb6625f going to sleep for 11 seconds 00000100:00100000:0.0:1787359915.978881:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942528 00000100:00100000:0.0:1787359915.978886:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942528 00000100:00100000:0.0:1787359915.978951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787359915.978957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2a6ae63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942528:12345-0@lo:502: 00000100:00100000:0.0:1787359915.979030:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2a6ae63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942528:12345-0@lo:502: Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359915.979037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359915.979093:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942528:0@lo:502: 00000040:00080000:1.0:1787359915.979125:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1787359915.979131:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1787359915.979471:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359915.979487:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359915.979489:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787359915.979493:0:7475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787359915.979496:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787359915.979511:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a917727a) 00000020:00000080:1.0:1787359915.979539:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1787359915.979544:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787359915.979617:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787359915.979622:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71fbd3 00000020:00000080:1.0:1787359915.979795:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787359915.979799:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359915.979802:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359915.979803:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787359915.979806:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359915.979809:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359915.979810:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787359915.979813:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787359915.979818:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003f44d6ec) 00000020:00000080:1.0:1787359915.979827:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787359915.979830:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787359915.979831:0:7475:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787359915.979834:0:7475:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787359915.979849:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787359915.979911:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ccb2bd57 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787359915.979922:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000006d642f96) 00000020:00000080:1.0:1787359915.979929:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787359915.979970:0:7475:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787359915.979973:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fbe8 00000020:00000080:1.0:1787359915.980053:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787359915.980058:0:7475:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787359915.980061:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x359a4e2aee71fbef 00080000:01000000:1.0:1787359915.980066:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787359915.980069:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71fbf6 00080000:10000000:1.0:1787359915.980379:0:7475:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787359915.980483:0:7475:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1787359916.038501:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1787359916.039379:0:7475:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1787359916.041293:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787359916.041583:0:7475:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787359916.047706:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787359916.047719:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359916.047725:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.047727:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787359916.047730:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359916.047736:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.047738:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787359916.047742:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787359916.047747:0:7475:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:1.0:1787359916.047772:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787359916.047783:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000bf66b7e1) 00000020:00000080:1.0:1787359916.047801:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787359916.047807:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787359916.047886:0:7475:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787359916.047892:0:7475:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787359916.047899:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71fc04 00010000:00080000:1.0:1787359916.047929:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004282e28a@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787359916.049738:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787359916.051280:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787359916.051292:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787359916.051322:0:7475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787359916.051340:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fc0b 00000100:00080000:1.0:1787359916.051349:0:7475:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359916.051354:0:7475:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004282e28a using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787359916.051381:0:7475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000377f936d x1874182595942656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787359916.051402:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787359916.051432:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595942656:0@lo:38: 00000020:01000000:1.0:1787359916.051510:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359916.051525:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051531:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787359916.051536:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:0.0:1787359916.051539:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787359916.051540:0:7475:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787359916.051544:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787359916.051545:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787359916.051547:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787359916.051550:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051552:0:7475:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787359916.051555:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359916.051560:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051561:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787359916.051565:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787359916.051600:0:7475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787359916.051615:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1787359916.051615:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942656 00000020:00000080:1.0:1787359916.051621:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051623:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:0.0:1787359916.051623:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942656 00000020:01000000:1.0:1787359916.051629:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359916.051633:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051634:0:7475:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787359916.051639:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787359916.051640:0:7475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359916.051658:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1787359916.051666:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1787359916.051666:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b149374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182595942656:12345-0@lo:38: 00000020:00000080:1.0:1787359916.051671:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359916.051673:0:7475:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359916.051677:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00010000:00080000:0.0:1787359916.051690:0:6536:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000100:00100000:1.0:1787359916.051832:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:01000000:2.0:1787359916.051859:0:7461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787359916.051901:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787359916.051913:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.051923:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000016f61d6b/0x359a4e2aee71fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359916.051931:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a10f4d000 from 1 10000000:01000000:2.0:1787359916.051934:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787359916.051955:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.051962:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.051970:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.051988:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942912:0@lo:101: 00000100:00100000:2.0:1787359916.052019:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.052035:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061209129 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.052092:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595942784:0@lo:400: 00000020:00000080:0.0:1787359916.052138:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fc19 00000100:00100000:1.0:1787359916.052145:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1787359916.052153:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787359916.052159:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787359916.052223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942912 00000100:00100000:1.0:1787359916.052249:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942912 00000100:00100000:1.0:1787359916.052289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359916.052296:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9f66a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+12:7461:x1874182595942912:12345-0@lo:101: 00010000:00010000:1.0:1787359916.052308:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359916.052323:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc12 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.052342:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.052352:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.052360:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ffb7e25, rc 0) 00000100:00100000:1.0:1787359916.052391:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9f66a5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:7461:x1874182595942912:12345-0@lo:101: Request processed in 96us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.052396:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787359916.052521:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595942784 00000100:00100000:2.0:1787359916.052525:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595942784 00000100:00100000:2.0:1787359916.052587:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787359916.052594:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e25f97c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595942784:12345-0@lo:400: 00000100:00100000:2.0:1787359916.052632:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e25f97c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595942784:12345-0@lo:400: Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.052647:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787359916.052736:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000046fe5902 x1874182595942784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359916.052748:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595942784:0@lo:400: 00000100:00100000:2.0:1787359916.052801:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595942912:0@lo:101: 00010000:00010000:2.0:1787359916.052814:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.052822:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.053349:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943040:0@lo:256: 00000100:00100000:2.0:1787359916.053384:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.053418:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061209129 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.053508:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943040 00000100:00100000:0.0:1787359916.053513:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943040 00000100:00100000:0.0:1787359916.053551:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787359916.053557:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e24a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:7461:x1874182595943040:12345-0@lo:256: 20000000:01000000:0.0:1787359916.053569:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787359916.053582:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787359916.053585:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787359916.053799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e24a83a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:7461:x1874182595943040:12345-0@lo:256: Request processed in 241us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.053806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787359916.053856:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943040:0@lo:256: 10000000:01000000:2.0:1787359916.054515:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787359916.054534:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.054543:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359916.054550:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a10f4d000 from 1 10000000:01000000:2.0:1787359916.054553:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359916.054571:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.054577:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.054584:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.055152:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943168:0@lo:101: 00000100:00100000:2.0:1787359916.055194:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.055325:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061209129 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.055461:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943168 00000100:00100000:1.0:1787359916.055468:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943168 00000100:00100000:1.0:1787359916.055532:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787359916.055540:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c26f9466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:7461:x1874182595943168:12345-0@lo:101: 00010000:00010000:1.0:1787359916.055551:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359916.055563:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc27 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.055580:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.055589:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.055610:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006dfc8730, rc 0) 00000100:00100000:1.0:1787359916.055682:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c26f9466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943168:12345-0@lo:101: Request processed in 143us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.055688:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787359916.055751:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943168:0@lo:101: 00010000:00010000:2.0:1787359916.055762:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.055769:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.055848:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943296:0@lo:501: 00000100:00100000:2.0:1787359916.055881:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.055901:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061209129 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.056821:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943296 00000100:00100000:1.0:1787359916.056828:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943296 00000100:00100000:1.0:1787359916.056891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359916.056899:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e59331a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943296:12345-0@lo:501: 00000100:00100000:1.0:1787359916.057339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e59331a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943296:12345-0@lo:501: Request processed in 439us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.057348:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787359916.058508:0:6536:0:(import.c:65:import_set_state_nolock()) 00000000341197f1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359916.058579:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b149374 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182595942656:12345-0@lo:38: Request processed in 6913us (7043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.058591:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359916.058608:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787359916.058617:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787359916.058624:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787359916.058629:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787359916.058631:0:3657:0:(import.c:65:import_set_state_nolock()) 000000004282e28a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787359916.058647:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595942656:0@lo:38: 00000100:00100000:3.0:1787359916.058756:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943296:0@lo:501: 00000100:00100000:3.0:1787359916.058793:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943424:0@lo:503: 00000100:00100000:3.0:1787359916.058832:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.058932:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359916.058940:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595943552:0@lo:41: 00000100:00100000:2.0:1787359916.058968:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359916.059041:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000006397ea55 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.059076:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943424 00000100:00100000:0.0:1787359916.059081:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943424 00000100:00100000:0.0:1787359916.059148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787359916.059155:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5d80f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943424:12345-0@lo:503: 00000040:00080000:0.0:1787359916.059190:0:6526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359916.059288:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5d80f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943424:12345-0@lo:503: Request processed in 133us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.059294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787359916.059345:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943552 00000100:00100000:3.0:1787359916.059347:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943424:0@lo:503: 00000100:00100000:1.0:1787359916.059351:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943552 00000100:00100000:1.0:1787359916.059381:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787359916.059389:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b98e657 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1874182595943552:12345-0@lo:41: 00000004:00000024:1.0:1787359916.059410:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787359916.059493:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b98e657 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1874182595943552:12345-0@lo:41: Request processed in 105us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.059500:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787359916.059538:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595943552:0@lo:41: 00000040:00080000:3.0:1787359916.059583:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359916.059624:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1787359916.059688:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359916.061172:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1787359916.061382:0:7461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787359916.061410:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359916.061455:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.061466:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359916.061531:0:7461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787359916.061534:0:7461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a10f4d000 10000000:01000000:2.0:1787359916.061536:0:7461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a10f4d000 10000000:01000000:2.0:1787359916.061540:0:7461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787359916.061545:0:7461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a10f4d000 from 1 10000000:01000000:2.0:1787359916.061547:0:7461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359916.061574:0:7461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.061581:0:7461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.061590:0:7461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.061607:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943680:0@lo:101: 00000100:00100000:2.0:1787359916.061658:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.061699:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089d1ce13 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.061742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943680 00000100:00100000:1.0:1787359916.061749:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943680 00000100:00100000:1.0:1787359916.061788:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787359916.061795:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca68775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:7461:x1874182595943680:12345-0@lo:101: 00010000:00010000:1.0:1787359916.061807:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359916.061816:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7f4ef4a/0x359a4e2aee71fc3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc35 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.061836:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7f4ef4a/0x359a4e2aee71fc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.061847:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7f4ef4a/0x359a4e2aee71fc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.061854:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7f4ef4a, rc 0) 00000100:00100000:1.0:1787359916.061906:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca68775 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595943680:12345-0@lo:101: Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.061914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787359916.061938:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943680:0@lo:101: 00010000:00010000:2.0:1787359916.061951:0:7461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.061958:0:7461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.062025:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943808:0@lo:501: 00000100:00100000:2.0:1787359916.062047:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.062073:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089d1ce13 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.062122:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943808 00000100:00100000:0.0:1787359916.062126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943808 00000100:00100000:0.0:1787359916.062154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787359916.062160:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d17fdabc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595943808:12345-0@lo:501: 00000100:00100000:0.0:1787359916.062267:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d17fdabc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595943808:12345-0@lo:501: Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.062274:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359916.062413:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943808:0@lo:501: 00000100:00100000:3.0:1787359916.062438:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943936:0@lo:503: 00000100:00100000:3.0:1787359916.062474:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359916.062493:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000000342a725 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.062807:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595943936 00000100:00100000:1.0:1787359916.062812:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595943936 00000100:00100000:1.0:1787359916.062842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787359916.062848:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003360f0a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595943936:12345-0@lo:503: 00000100:00100000:1.0:1787359916.062950:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003360f0a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595943936:12345-0@lo:503: Request processed in 102us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.062957:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787359916.063100:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595943936:0@lo:503: 00000040:00080000:3.0:1787359916.063335:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787359916.063390:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944064:0@lo:502: 00000100:00100000:3.0:1787359916.063422:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359916.063495:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000000342a725 going to sleep for 11 seconds 00000100:00100000:2.0:1787359916.063761:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944064 00000100:00100000:2.0:1787359916.063766:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944064 00000100:00100000:2.0:1787359916.063834:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787359916.063841:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027776812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595944064:12345-0@lo:502: 00000100:00100000:2.0:1787359916.063945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027776812 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595944064:12345-0@lo:502: Request processed in 104us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.063952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787359916.064022:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944064:0@lo:502: 00000040:00080000:3.0:1787359916.064192:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787359916.064215:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787359916.064247:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787359916.064261:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787359916.064272:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787359916.064283:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787359916.064294:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787359916.064304:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787359916.064315:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787359916.064325:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787359916.064337:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787359916.064349:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787359916.064361:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787359916.064373:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787359916.064383:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787359916.064394:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787359916.064404:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787359916.064416:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787359916.064427:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787359916.064437:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787359916.064448:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787359916.064459:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787359916.064478:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787359916.064491:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787359916.064502:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787359916.064527:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787359916.064540:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787359916.064552:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787359916.064571:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944192:0@lo:502: 00000100:00100000:3.0:1787359916.064605:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359916.065047:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000000342a725 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.065107:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944192 00000100:00100000:0.0:1787359916.065113:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944192 00000100:00100000:0.0:1787359916.065140:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787359916.065146:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c901af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595944192:12345-0@lo:502: 00000100:00100000:0.0:1787359916.065291:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c901af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595944192:12345-0@lo:502: Request processed in 144us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.065303:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787359916.065962:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944192:0@lo:502: 00000040:00080000:3.0:1787359916.066076:0:7461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787359916.066087:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787359916.066591:0:7481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787359916.066603:0:7481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000081d323ba) 00000020:00000080:3.0:1787359916.066621:0:7481:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787359916.066685:0:7481:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ccb2bd57 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787359916.066688:0:7481:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ccb2bd57 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787359916.066690:0:7481:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ccb2bd57 3 00010000:00080000:3.0:1787359916.066716:0:7481:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ffd5aee4@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787359916.070658:0:7481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787359916.070856:0:7481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787359916.070904:0:7481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787359916.070913:0:7481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x359a4e2aee71fc4a 00000100:00080000:3.0:1787359916.070922:0:7481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359916.070926:0:7481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ffd5aee4 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787359916.070954:0:7481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000865b7a1c x1874182595944320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787359916.070980:0:7481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787359916.071035:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182595944320:0@lo:38: 00000100:00100000:0.0:1787359916.071094:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359916.071143:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944320 00000100:00100000:0.0:1787359916.071149:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944320 00000100:00100000:0.0:1787359916.071181:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359916.071188:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c60804 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182595944320:12345-0@lo:38: 00010000:00080000:0.0:1787359916.071207:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1787359916.071247:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x359a4e2aee71fc51 00000004:00100000:0.0:1787359916.071259:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787359916.071284:0:6532:0:(import.c:65:import_set_state_nolock()) 00000000a3db7b35 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359916.071327:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c60804 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874182595944320:12345-0@lo:38: Request processed in 139us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.071334:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787359916.071365:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000865b7a1c x1874182595944320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359916.071374:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787359916.071380:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787359916.071386:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787359916.071390:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787359916.071392:0:3657:0:(import.c:65:import_set_state_nolock()) 00000000ffd5aee4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787359916.071396:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000865b7a1c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182595944320:0@lo:38: 00000040:00080000:3.0:1787359916.071694:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787359916.071843:0:7461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787359916.071885:0:7461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359916.071902:0:7461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.071917:0:7461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000c6e88df0/0x359a4e2aee71fc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787359916.071961:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787359916.071963:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787359916.071965:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359916.071966:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359916.071967:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359916.071969:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359916.071970:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359916.071972:0:7461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359916.071973:0:7461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359916.071974:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359916.071976:0:7461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359916.071979:0:7461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1787359916.071981:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359916.071983:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787359916.071983:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359916.071984:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359916.071985:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359916.071986:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359916.071988:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359916.071989:0:7461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359916.071990:0:7461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359916.071991:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359916.071992:0:7461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359916.072006:0:7461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787359916.072015:0:7461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d72b1436 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944448:0@lo:253: 00000100:00100000:0.0:1787359916.072049:0:7461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359916.072072:0:7461:0:(client.c:2715:ptlrpc_set_wait()) set 000000000c123d1d going to sleep for 11 seconds 40000000:00080000:2.0:1787359916.072195:0:7482:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1787359916.072606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944448 00000100:00100000:0.0:1787359916.072612:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944448 00000100:00100000:0.0:1787359916.072680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787359916.072687:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d84afae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7461:x1874182595944448:12345-0@lo:253: 20000000:01000000:0.0:1787359916.072718:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787359916.072728:0:6525:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787359916.077040:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787359916.077276:0:6525:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787359916.077289:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787359916.077457:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787359916.077462:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787359916.077478:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077499:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077505:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077511:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077541:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077553:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 15 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359916.077565:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595944576:0@lo:104: 00000100:00100000:1.0:1787359916.077619:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359916.077665:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.077672:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359916.077679:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b14e263 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595944704:0@lo:104: 00000100:00100000:1.0:1787359916.077697:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.077718:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9c558fd going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.077827:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944576 00000100:00100000:0.0:1787359916.077834:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944576 00000100:00100000:0.0:1787359916.077862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944704 00000100:00100000:0.0:1787359916.077864:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944704 00000100:00100000:0.0:1787359916.077888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359916.077894:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b7c93a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595944576:12345-0@lo:104: 00010000:00010000:0.0:1787359916.077905:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.077961:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359916.077965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b7c93a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595944576:12345-0@lo:104: Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.077972:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359916.077986:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359916.077990:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000950a5858 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595944704:12345-0@lo:104: 00010000:00010000:0.0:1787359916.077996:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.078026:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787359916.078030:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000950a5858 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595944704:12345-0@lo:104: Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.078035:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787359916.078077:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787359916.078083:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078100:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a4ce2c1 already unused, calling callback (0000000010c5082c) 10000000:00010000:1.0:1787359916.078102:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078109:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359916.078115:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359916.078120:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359916.078147:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.078150:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595944576:0@lo:104: 00010000:00010000:1.0:1787359916.078160:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787359916.078166:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b14e263 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595944704:0@lo:104: 00010000:00010000:1.0:1787359916.078184:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.078192:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078192:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000000a4ce2c1/0x359a4e2aee71fc12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc20 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359916.078301:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d2c2013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595944832:0@lo:103: 00000100:00100000:0.0:1787359916.078327:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359916.078413:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359916.078416:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078422:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008966557c already unused, calling callback (0000000010c5082c) 10000000:00010000:1.0:1787359916.078424:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078438:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359916.078444:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359916.078449:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359916.078461:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078467:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359916.078478:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078484:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000008966557c/0x359a4e2aee71fb71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb78 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359916.078498:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359916.078500:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359916.078503:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359916.078508:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944832 00000100:00100000:1.0:1787359916.078517:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359916.078524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944832 00000100:00100000:1.0:1787359916.078526:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000afb04820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595944960:0@lo:103: 00010000:00010000:2.0:1787359916.078548:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 16 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359916.078559:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359916.078697:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359916.079375:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d84afae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:7461:x1874182595944448:12345-0@lo:253: Request processed in 6688us (7325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.079384:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787359916.079427:0:7461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d72b1436 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7461:1874182595944448:0@lo:253: 10000000:01000000:1.0:1787359916.079442:0:7461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787359916.079450:0:7461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787359916.079451:0:7461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787359916.079453:0:7461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359916.079454:0:7461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359916.079455:0:7461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359916.079456:0:7461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359916.079457:0:7461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787359916.079459:0:7461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359916.079460:0:7461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359916.079461:0:7461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359916.079463:0:7461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787359916.079475:0:7461:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787359916.081904:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595944960 00000100:00100000:2.0:1787359916.081918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595944960 00010000:00010000:2.0:1787359916.081955:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 16 pid: 6526 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.081994:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787359916.082172:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036c29b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595944832:12345-0@lo:103: 00010000:00010000:2.0:1787359916.082187:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359916.082192:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 16 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.082212:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 16 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.082246:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ffb7e25/0x359a4e2aee71fc20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc12 expref: 16 pid: 6525 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359916.082256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787359916.082263:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359916.082268:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b08c99c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3661:x1874182595944960:12345-0@lo:103: 00010000:00010000:0.0:1787359916.082279:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359916.082284:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082294:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082306:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a2355649/0x359a4e2aee71fb78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fb71 expref: 15 pid: 6526 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082320:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082328:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.082336:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036c29b34 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3659:x1874182595944832:12345-0@lo:103: Request processed in 333us (4007us total) trans 0 rc 0/0 20000000:01000000:0.0:1787359916.082342:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004880570s 00000100:00100000:2.0:1787359916.082345:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787359916.082349:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082357:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082363:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082369:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082373:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd256e7f already unused, calling callback (000000006ae1db34) 00010000:00010000:0.0:1787359916.082382:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082389:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082403:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359916.082413:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359916.083611:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d2c2013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595944832:0@lo:103: 00010000:00010000:2.0:1787359916.083643:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.083654:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359916.083659:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc58 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359916.085178:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000afb04820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595944960:0@lo:103: 00080000:10000000:1.0:1787359916.085198:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:0.0:1787359916.085261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b08c99c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:3661:x1874182595944960:12345-0@lo:103: Request processed in 2836us (6542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.085271:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:1.0:1787359916.085478:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787359916.086405:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787359916.086693:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787359916.086861:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787359916.087661:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787359916.088566:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787359916.088755:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787359916.088921:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787359916.089075:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787359916.089215:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787359916.089401:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1787359916.093293:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787359916.093294:0:7486:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787359916.093300:0:7486:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787359916.094319:0:7487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1787359916.094378:0:7487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006591f5b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1874182595945088:0@lo:700: 00000100:00100000:0.0:1787359916.094437:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1787359916.094463:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787359916.094954:0:7487:0:(client.c:2715:ptlrpc_set_wait()) set 00000000193d9400 going to sleep for 11 seconds 00000100:00100000:3.0:1787359916.094976:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945088 00000100:00100000:3.0:1787359916.094985:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945088 00000100:00100000:3.0:1787359916.095257:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359916.095267:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087109271 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1874182595945088:12345-0@lo:700: 00000100:00100000:2.0:1787359916.095695:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945216:0@lo:1000: 00000100:00100000:2.0:1787359916.095749:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.095783:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073854628 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.095832:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945216 00000100:00100000:0.0:1787359916.095837:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945216 00000100:00100000:0.0:1787359916.095966:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359916.095974:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025329c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945216:12345-0@lo:1000: 00000100:00100000:0.0:1787359916.096041:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025329c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945216:12345-0@lo:1000: Request processed in 68us (292us total) trans 0 rc 0/0 00000040:01000000:3.0:1787359916.096189:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1787359916.096280:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1787359916.096337:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787359916.096855:0:7461:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787359916.096862:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787359916.097003:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359916.098172:0:7461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1787359916.098818:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945216:0@lo:1000: 00000040:01000000:2.0:1787359916.098882:0:7488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1787359916.098923:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945344:0@lo:700: 00000100:00100000:2.0:1787359916.098974:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.099011:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000476540d7 going to sleep for 11 seconds 00000100:00100000:1.0:1787359916.099521:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945344 00000100:00100000:1.0:1787359916.099528:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945344 00000100:00100000:1.0:1787359916.099591:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359916.099600:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007950e109 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945344:12345-0@lo:700: 00000100:00100000:1.0:1787359916.099660:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007950e109 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945344:12345-0@lo:700: Request processed in 61us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.099668:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359916.099844:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945344:0@lo:700: 00000100:00100000:2.0:1787359916.099934:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1874182595945472:0@lo:900: 00000100:00100000:2.0:1787359916.099962:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.099995:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000476540d7 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.100347:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945472 00000100:00100000:0.0:1787359916.100364:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945472 00000100:00100000:0.0:1787359916.100397:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359916.100404:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d13346a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1874182595945472:12345-0@lo:900: 00000100:00100000:0.0:1787359916.100451:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d13346a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1874182595945472:12345-0@lo:900: Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.100458:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787359916.100685:0:7488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001863f58b x1874182595945472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787359932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359916.100697:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001863f58b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1874182595945472:0@lo:900: 00000100:00100000:1.0:1787359916.100783:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a28edd7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945600:0@lo:1000: 00000100:00100000:1.0:1787359916.100814:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.100845:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 000000001bab38a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.100903:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945600 00000100:00100000:0.0:1787359916.100908:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945600 00000100:00100000:0.0:1787359916.100932:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359916.100942:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000546b553d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945600:12345-0@lo:1000: 40000000:02000000:1.0:1787359916.101080:0:6538:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1787359916.101509:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000546b553d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945600:12345-0@lo:1000: Request processed in 570us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.101517:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359916.102642:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a28edd7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945600:0@lo:1000: 00000004:00080000:2.0:1787359916.102772:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c994566b with version 0 00000020:00100000:2.0:1787359916.102790:0:7488:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787359916.102795:0:7488:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000035fddb65 x1874182595945856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787359916.102812:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945856:0@lo:1000: 00000100:00100000:2.0:1787359916.102852:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787359916.102885:0:7461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1787359916.102932:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945856 00000100:00100000:2.0:1787359916.102938:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945856 00000040:01000000:3.0:1787359916.102966:0:7461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:2.0:1787359916.102979:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787359916.102987:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab00487 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945856:12345-0@lo:1000: 00000040:00080000:3.0:1787359916.103349:0:7461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787359916.103584:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000476540d7 going to sleep for 11 seconds 00080000:10000000:3.0:1787359916.104594:0:7461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787359916.105180:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787359916.105323:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787359916.105439:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787359916.105574:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787359916.105705:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787359916.105910:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787359916.106033:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787359916.106158:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787359916.106311:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787359916.106436:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787359916.106554:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:1.0:1787359916.106803:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087109271 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1874182595945088:12345-0@lo:700: Request processed in 11534us (12362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.106821:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787359916.106885:0:7487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006591f5b9 x1874182595945088/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787359932 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359916.106900:0:7487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006591f5b9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1874182595945088:0@lo:700: 40000000:02000000:1.0:1787359916.106913:0:7487:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1787359916.107701:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787359916.107843:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787359916.107977:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787359916.108177:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787359916.108369:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787359916.108623:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787359916.108734:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787359916.109485:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787359916.109895:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787359916.110012:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787359916.110155:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787359916.110312:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787359916.110451:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787359916.110776:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787359916.110910:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787359916.111026:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787359916.111305:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787359916.111430:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787359916.111589:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787359916.111704:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787359916.111829:0:7461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00080000:2.0:1787359916.112613:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1787359916.112713:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab00487 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945856:12345-0@lo:1000: Request processed in 9724us (9857us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787359916.112724:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1787359916.112768:0:7488:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787359916.112772:0:7488:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787359916.112791:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945856:0@lo:1000: 00000100:00100000:2.0:1787359916.112859:0:7488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945984:0@lo:1000: 00000100:00100000:2.0:1787359916.112901:0:7488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.113015:0:7488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016d6e47e going to sleep for 11 seconds 00000001:00000004:3.0:1787359916.113646:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787359916.114544:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595945984 00000100:00100000:0.0:1787359916.114554:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595945984 00000100:00100000:0.0:1787359916.114660:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359916.114671:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ef11c69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945984:12345-0@lo:1000: 00000100:00100000:0.0:1787359916.114767:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ef11c69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1874182595945984:12345-0@lo:1000: Request processed in 99us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.114774:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359916.115161:0:7488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1874182595945984:0@lo:1000: 00000040:00080000:2.0:1787359916.115185:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787359916.115220:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000080355653 with version 1 00000004:00080000:2.0:1787359916.115252:0:7478:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000001aeed0ff version 1 rpc_version 1 00000020:00100000:2.0:1787359916.115269:0:7478:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787359916.115276:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000035fddb65 x1874182595946240/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787359916.115295:0:7478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1874182595946240:0@lo:1000: 00000100:00100000:2.0:1787359916.115328:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359916.115355:0:7478:0:(client.c:2715:ptlrpc_set_wait()) set 0000000076f35a2d going to sleep for 11 seconds 00000100:00100000:0.0:1787359916.116606:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946240 00000100:00100000:0.0:1787359916.116614:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946240 00000100:00100000:0.0:1787359916.116658:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359916.116666:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001863f58b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1874182595946240:12345-0@lo:1000: 00000040:00080000:2.0:1787359916.120163:0:7488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787359916.120390:0:7488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787359916.121532:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787359916.122922:0:7461:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787359916.123170:0:7461:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4f7819c7988 00100000:10000000:3.0:1787359916.123179:0:7461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:3.0:1787359916.123319:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787359916.123616:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001863f58b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1874182595946240:12345-0@lo:1000: Request processed in 6946us (8284us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787359916.123628:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:3.0:1787359916.123656:0:7461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 00000004:00080000:0.0:1787359916.123668:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787359916.123673:0:7478:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 10000000:01000000:3.0:1787359916.123687:0:7461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000100:00100000:0.0:1787359916.123689:0:7478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035fddb65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1874182595946240:0@lo:1000: 00000020:01000004:3.0:1787359916.123810:0:7461:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787359916.123825:0:7461:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787359916.125299:0:7461:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787359916.125633:0:7461:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1787359916.128721:0:7487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787359916.128792:0:7487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787359916.128796:0:7487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787359916.155134:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359917.178785:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359918.202257:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359919.226762:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359920.252408:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787359920.558157:0:7733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787359921.278410:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359921.401632:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000afb04820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595946368:0@lo:400: 00000100:00100000:0.0:1787359921.401722:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.401777:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359921.401782:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595946752:0@lo:400: 00000100:00100000:2.0:1787359921.401806:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b14e263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595946624:0@lo:400: 00000100:00100000:0.0:1787359921.401808:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.401829:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005aa8becf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595946880:0@lo:41: 00000100:00100000:2.0:1787359921.401861:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.401873:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946368 00000100:00100000:0.0:1787359921.401880:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946368 00000100:00100000:0.0:1787359921.401930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787359921.401939:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef21b3c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:3661:x1874182595946368:12345-0@lo:400: 00000100:00100000:0.0:1787359921.401983:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef21b3c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:3661:x1874182595946368:12345-0@lo:400: Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.401991:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787359921.402021:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946752 00000100:00100000:0.0:1787359921.402025:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946752 00000100:00100000:0.0:1787359921.402057:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359921.402063:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036c29b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595946752:12345-0@lo:400: 00000100:00100000:0.0:1787359921.402094:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036c29b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595946752:12345-0@lo:400: Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.402100:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359921.402118:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359921.402213:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d2c2013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595946496:0@lo:400: 00000100:00100000:1.0:1787359921.402267:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787359921.402444:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000377f936d x1874182595946752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359921.402456:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000377f936d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595946752:0@lo:400: 00000100:00100000:0.0:1787359921.402465:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000afb04820 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595946368:0@lo:400: 00000100:00100000:0.0:1787359921.402629:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946496 00000100:00100000:0.0:1787359921.402634:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946496 00000100:00100000:0.0:1787359921.402672:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359921.402678:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d3cab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595946496:12345-0@lo:400: 00000100:00100000:0.0:1787359921.402716:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d3cab92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595946496:12345-0@lo:400: Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.402722:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787359921.402746:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008d2c2013 x1874182595946496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359921.402755:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d2c2013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595946496:0@lo:400: 00000100:00100000:2.0:1787359921.402863:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946624 00000100:00100000:2.0:1787359921.402869:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946624 00000100:00100000:2.0:1787359921.402890:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595946880 00000100:00100000:2.0:1787359921.402892:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595946880 00000100:00100000:2.0:1787359921.402903:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359921.402908:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec41c1f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1874182595946624:12345-0@lo:400: 00000100:00100000:2.0:1787359921.402973:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec41c1f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3659:x1874182595946624:12345-0@lo:400: Request processed in 65us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359921.402980:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359921.402992:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787359921.402997:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039c9ff68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595946880:12345-0@lo:41: 00000004:00000024:2.0:1787359921.403016:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787359921.403046:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039c9ff68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595946880:12345-0@lo:41: Request processed in 50us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359921.403051:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359921.403851:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b14e263 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595946624:0@lo:400: 00000100:00100000:0.0:1787359921.403892:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005aa8becf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595946880:0@lo:41: 00000020:00000004:3.0:1787359921.753728:0:7785:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787359921.754047:0:7785:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787359922.298054:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359923.323347:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359924.345438:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787359924.475956:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787359924.476321:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a10f4d000 from 4 10000000:01000000:3.0:1787359924.476328:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787359924.476392:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.476407:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.476419:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359924.476528:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947008:0@lo:101: 00000100:00100000:3.0:1787359924.476624:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.477072:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947008 00000100:00100000:0.0:1787359924.477082:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947008 00000100:00100000:0.0:1787359924.477154:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787359924.477164:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5d3f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:6528:x1874182595947008:12345-0@lo:101: 00010000:00010000:0.0:1787359924.477182:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359924.477198:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000502ba2f/0x359a4e2aee71fc66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc5f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.477246:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000502ba2f/0x359a4e2aee71fc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.477257:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000502ba2f/0x359a4e2aee71fc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.477267:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000502ba2f, rc 0) 00000100:00100000:0.0:1787359924.477332:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5d3f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:6528:x1874182595947008:12345-0@lo:101: Request processed in 169us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.477356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787359924.479290:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ad847c8 going to sleep for 11 seconds 00000100:00100000:3.0:1787359924.479396:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947008:0@lo:101: 00010000:00010000:3.0:1787359924.479429:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.479444:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359924.479840:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947136:0@lo:256: 00000100:00100000:3.0:1787359924.479925:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359924.479959:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ad847c8 going to sleep for 11 seconds 00000100:00100000:3.0:1787359924.480073:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947136 00000100:00100000:3.0:1787359924.480080:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947136 00000100:00100000:3.0:1787359924.480133:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787359924.480144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080c05eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:6528:x1874182595947136:12345-0@lo:256: 20000000:01000000:3.0:1787359924.480170:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787359924.480191:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787359924.480195:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787359924.480681:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080c05eac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:6528:x1874182595947136:12345-0@lo:256: Request processed in 537us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359924.480693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787359924.481180:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947136:0@lo:256: 10000000:01000000:3.0:1787359924.481341:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787359924.481353:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.481364:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000006898cfb7/0x359a4e2aee71fc5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359924.481378:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787359924.481381:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a0ffaa800 from 21 10000000:01000000:3.0:1787359924.481385:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787359924.481421:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.481430:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359924.481453:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359924.481472:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947264:0@lo:101: 00000100:00100000:3.0:1787359924.481510:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359924.481673:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ad847c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.483159:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947264 00000100:00100000:2.0:1787359924.483176:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947264 00000100:00100000:2.0:1787359924.483267:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787359924.483289:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000780e38d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:6528:x1874182595947264:12345-0@lo:101: 00010000:00010000:2.0:1787359924.483309:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359924.483340:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7af2165/0x359a4e2aee71fc74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc6d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.483372:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7af2165/0x359a4e2aee71fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.483384:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7af2165/0x359a4e2aee71fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.483414:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7af2165, rc 0) 00000100:00100000:2.0:1787359924.483747:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000780e38d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947264:12345-0@lo:101: Request processed in 460us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.483757:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787359924.483840:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007007e071 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947264:0@lo:101: 00010000:00010000:2.0:1787359924.483864:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.483875:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359924.484108:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947392:0@lo:501: 00000100:00100000:2.0:1787359924.484146:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.484181:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084db9db6 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.484199:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947392 00000100:00100000:2.0:1787359924.484204:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947392 00000100:00100000:2.0:1787359924.484257:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787359924.484265:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e71cc3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947392:12345-0@lo:501: 00000100:00100000:2.0:1787359924.484675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e71cc3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947392:12345-0@lo:501: Request processed in 410us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.484683:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787359924.484717:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947392:0@lo:501: 00000100:00100000:2.0:1787359924.484748:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947520:0@lo:503: 00000100:00100000:2.0:1787359924.484795:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.484814:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084db9db6 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.484842:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947520 00000100:00100000:2.0:1787359924.484847:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947520 00000100:00100000:2.0:1787359924.484866:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787359924.484872:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc87dbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947520:12345-0@lo:503: 00000100:00100000:2.0:1787359924.485631:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc87dbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947520:12345-0@lo:503: Request processed in 756us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.485640:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787359924.490670:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050e2bb7d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947520:0@lo:503: 00000100:00100000:1.0:1787359924.498040:0:7857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7857:1874182595947648:0@lo:502: 00000100:00100000:1.0:1787359924.498164:0:7857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359924.498245:0:7857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057165614 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.498720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947648 00000100:00100000:2.0:1787359924.498731:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947648 00000100:00100000:2.0:1787359924.498801:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787359924.498812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013223029 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7857:x1874182595947648:12345-0@lo:502: 00000100:00100000:2.0:1787359924.498991:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013223029 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7857:x1874182595947648:12345-0@lo:502: Request processed in 180us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.499001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787359924.500655:0:7857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7857:1874182595947648:0@lo:502: 00000100:00100000:1.0:1787359924.500760:0:7857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7857:1874182595947776:0@lo:502: 00000100:00100000:1.0:1787359924.500850:0:7857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359924.501326:0:7857:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057165614 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.503210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947776 00000100:00100000:2.0:1787359924.503239:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947776 00000100:00100000:2.0:1787359924.503324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787359924.503335:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009293cac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7857:x1874182595947776:12345-0@lo:502: 00000100:00100000:2.0:1787359924.503549:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009293cac5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:7857:x1874182595947776:12345-0@lo:502: Request processed in 215us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.503558:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787359924.504096:0:7857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7857:1874182595947776:0@lo:502: 00000040:00080000:1.0:1787359924.504145:0:7857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787359924.504678:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787359924.504707:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359924.504719:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.504732:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000009ca65bfb/0x359a4e2aee71fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359924.504760:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787359924.504762:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a0ffaa800 from 4 10000000:01000000:2.0:1787359924.504766:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787359924.504807:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.504815:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.504836:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359924.504859:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947904:0@lo:101: 00000100:00100000:2.0:1787359924.504917:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359924.505016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595947904 00000100:00100000:1.0:1787359924.505023:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595947904 00000100:00100000:1.0:1787359924.505073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787359924.505083:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c23e659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595947904:12345-0@lo:101: 00010000:00010000:1.0:1787359924.505095:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359924.505110:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc7b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359924.505137:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359924.505149:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd256e7f/0x359a4e2aee71fc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359924.505158:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd256e7f, rc 0) 00000100:00100000:2.0:1787359924.505214:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016d6e47e going to sleep for 11 seconds 00000100:00100000:1.0:1787359924.505760:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c23e659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595947904:12345-0@lo:101: Request processed in 676us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.505770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787359924.505865:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595947904:0@lo:101: 00010000:00010000:2.0:1787359924.505881:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.505892:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359924.506200:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948032:0@lo:256: 00000100:00100000:2.0:1787359924.506272:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.506302:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016d6e47e going to sleep for 11 seconds 00000100:00100000:1.0:1787359924.506468:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948032 00000100:00100000:1.0:1787359924.506546:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948032 00000100:00100000:1.0:1787359924.506598:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787359924.506606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffede7dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595948032:12345-0@lo:256: 20000000:01000000:1.0:1787359924.506627:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787359924.506650:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787359924.506654:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787359924.506758:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffede7dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595948032:12345-0@lo:256: Request processed in 152us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.506775:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787359924.506933:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948032:0@lo:256: 10000000:01000000:0.0:1787359924.506992:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787359924.507000:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.507008:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 00000000ef23550b/0x359a4e2aee71fc7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359924.507017:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787359924.507020:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787359924.507022:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359924.507049:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.507056:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.507064:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359924.507081:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a670d2e3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948160:0@lo:101: 00000100:00100000:0.0:1787359924.507111:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.507137:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ce79cdb going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.508191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948160 00000100:00100000:2.0:1787359924.508206:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948160 00000100:00100000:2.0:1787359924.508289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359924.508392:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d13f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595948160:12345-0@lo:101: 00010000:00010000:2.0:1787359924.508411:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359924.508432:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c5cfb10/0x359a4e2aee71fc90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fc89 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.508465:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c5cfb10/0x359a4e2aee71fc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.508539:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c5cfb10/0x359a4e2aee71fc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.508548:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c5cfb10, rc 0) 00000100:00100000:2.0:1787359924.508627:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d13f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595948160:12345-0@lo:101: Request processed in 316us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.508635:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359924.508698:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a670d2e3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948160:0@lo:101: 00010000:00010000:2.0:1787359924.508716:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359924.508726:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359924.508812:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948288:0@lo:501: 00000100:00100000:2.0:1787359924.508857:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.508877:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038db6c94 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.508896:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948288 00000100:00100000:2.0:1787359924.508901:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948288 00000100:00100000:2.0:1787359924.508921:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359924.508926:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000370f513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595948288:12345-0@lo:501: 00000100:00100000:2.0:1787359924.509067:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000370f513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595948288:12345-0@lo:501: Request processed in 140us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.509074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359924.509126:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948288:0@lo:501: 00000100:00100000:2.0:1787359924.509153:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948416:0@lo:503: 00000100:00100000:2.0:1787359924.509196:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.509209:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038db6c94 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.509220:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948416 00000100:00100000:2.0:1787359924.509249:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948416 00000100:00100000:0.0:1787359924.509641:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787359924.509659:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b421f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595948416:12345-0@lo:503: 00000100:00100000:0.0:1787359924.509779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b421f0ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595948416:12345-0@lo:503: Request processed in 129us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.509790:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787359924.509898:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595948416:0@lo:503: 00000100:00100000:1.0:1787359924.511000:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7858:1874182595948544:0@lo:502: 00000100:00100000:1.0:1787359924.511067:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359924.511148:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e2847986 going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.511618:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948544 00000100:00100000:0.0:1787359924.511629:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948544 00000100:00100000:1.0:1787359924.511746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787359924.511755:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008f57508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:7858:x1874182595948544:12345-0@lo:502: 00000100:00100000:1.0:1787359924.511955:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008f57508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:7858:x1874182595948544:12345-0@lo:502: Request processed in 201us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.511964:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787359924.512069:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f89e33b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7858:1874182595948544:0@lo:502: 00000020:01000000:0.0:1787359924.512104:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359924.512118:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359924.512122:0:7858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787359924.512127:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787359924.512130:0:7858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:0.0:1787359924.512160:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787359924.512179:0:7858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000038d23133) 00000020:00000080:0.0:1787359924.512205:0:7858:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787359924.512212:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787359924.512720:0:7858:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787359924.512728:0:7858:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787359924.512746:0:7858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fc9e 00010000:00080000:0.0:1787359924.512784:0:7858:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002f17682f@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787359924.518042:0:7858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787359924.519896:0:7858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787359924.519916:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787359924.520022:0:7858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787359924.520052:0:7858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71fca5 00000100:00080000:1.0:1787359924.520064:0:7858:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359924.520071:0:7858:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000002f17682f using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787359924.520116:0:7858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e43b16ff x1874182595948672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787359924.520187:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595948672:0@lo:38: 00000100:00080000:1.0:1787359924.520189:0:7858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787359924.520327:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.520396:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948672 00000100:00100000:0.0:1787359924.520413:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948672 00000100:00100000:0.0:1787359924.520458:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359924.520466:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf1259ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182595948672:12345-0@lo:38: 00000040:01000000:1.0:1787359924.520483:0:7858:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00010000:00080000:0.0:1787359924.520623:0:6537:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787359924.520661:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71fcac 00000004:00100000:0.0:1787359924.520679:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787359924.520681:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e13b4a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595948800:0@lo:400: 00000001:00000004:0.0:1787359924.520694:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787359924.520718:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.520785:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054f02809 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595948928:0@lo:400: 00000100:00100000:0.0:1787359924.520817:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359924.520841:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948800 00000100:00100000:3.0:1787359924.520846:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948800 00000100:00100000:0.0:1787359924.520858:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009548bbbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595949056:0@lo:400: 00000100:00100000:0.0:1787359924.520884:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.520925:0:6536:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787359924.520934:0:6536:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787359924.521082:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949056 00000100:00100000:3.0:1787359924.521086:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949056 00000100:00100000:1.0:1787359924.521176:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787359924.521185:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3d4adc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595948800:12345-0@lo:400: 00000100:00100000:1.0:1787359924.521279:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3d4adc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595948800:12345-0@lo:400: Request processed in 95us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.521293:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787359924.521312:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787359924.521318:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da365091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595949056:12345-0@lo:400: 00000100:00100000:1.0:1787359924.521360:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da365091 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595949056:12345-0@lo:400: Request processed in 42us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.521366:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787359924.521405:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e13b4a73 x1874182595948800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359924.521420:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e13b4a73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595948800:0@lo:400: 00010000:00080000:0.0:1787359924.521781:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009548bbbc x1874182595949056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359924.521794:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009548bbbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595949056:0@lo:400: 00000100:00080000:0.0:1787359924.521916:0:7861:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000001f6af157 x1874182595949184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359924.521925:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c53e9f1d going to sleep for 0 seconds 00000020:01000000:1.0:1787359924.522050:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359924.522056:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359924.522058:0:7858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787359924.522061:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359924.522065:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359924.522066:0:7858:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787359924.522069:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787359924.522070:0:7858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787359924.522090:0:7858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7858:1874182595949312:0@lo:502: 00000100:00100000:1.0:1787359924.522138:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359924.522166:0:7858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000222b11e4 going to sleep for 11 seconds 00000100:00100000:2.0:1787359924.522586:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595948928 00000100:00100000:2.0:1787359924.522595:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595948928 00000100:00100000:2.0:1787359924.522716:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359924.522724:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006290287a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595948928:12345-0@lo:400: 00000100:00100000:2.0:1787359924.522784:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006290287a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595948928:12345-0@lo:400: Request processed in 61us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359924.522790:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359924.522839:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054f02809 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595948928:0@lo:400: 00000100:00100000:0.0:1787359924.528329:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949312 00000100:00100000:0.0:1787359924.528353:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949312 00000100:00100000:0.0:1787359924.528469:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359924.528488:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4930f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:7858:x1874182595949312:12345-0@lo:502: 00000100:00100000:0.0:1787359924.528730:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4930f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:7858:x1874182595949312:12345-0@lo:502: Request processed in 245us (6591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.528738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787359924.530677:0:7858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8130f92 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:7858:1874182595949312:0@lo:502: 00000020:01000000:1.0:1787359924.530742:0:7858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359924.530755:0:7858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359924.530758:0:7858:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359924.530762:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787359924.531571:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787359924.531629:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787359924.531644:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.531660:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 000000008800ab1b/0x359a4e2aee71fc89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359924.531675:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787359924.531700:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a3bac8000 from 1 10000000:01000000:0.0:1787359924.531704:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359924.531749:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.531760:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.531771:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359924.531798:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595949440:0@lo:101: 00000100:00100000:0.0:1787359924.531898:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.531950:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cec0612 going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.531979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949440 00000100:00100000:0.0:1787359924.531987:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949440 00000100:00100000:0.0:1787359924.532046:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787359924.532055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d794d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595949440:12345-0@lo:101: 00010000:00010000:0.0:1787359924.532069:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359924.532081:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec85f0bb/0x359a4e2aee71fcba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fcb3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.532465:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec85f0bb/0x359a4e2aee71fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.532479:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec85f0bb/0x359a4e2aee71fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.532487:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec85f0bb, rc 0) 00000100:00100000:0.0:1787359924.532528:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d794d19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595949440:12345-0@lo:101: Request processed in 475us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.532544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787359924.532596:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595949440:0@lo:101: 00010000:00010000:0.0:1787359924.532609:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359924.532617:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359924.532679:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595949568:0@lo:501: 00000100:00100000:0.0:1787359924.532707:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.532727:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cec0612 going to sleep for 11 seconds 00000100:00100000:1.0:1787359924.532841:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949568 00000100:00100000:1.0:1787359924.532853:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949568 00000100:00100000:1.0:1787359924.532929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787359924.532939:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bcb9d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595949568:12345-0@lo:501: 00000100:00100000:1.0:1787359924.533077:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bcb9d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595949568:12345-0@lo:501: Request processed in 139us (368us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359924.533086:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787359924.533138:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595949568:0@lo:501: 10000000:01000000:1.0:1787359924.533179:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787359924.533187:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359924.533197:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: 0000000071af64f6/0x359a4e2aee71fcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787359924.534786:0:6537:0:(import.c:65:import_set_state_nolock()) 00000000d357e7c8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359924.534911:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf1259ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182595948672:12345-0@lo:38: Request processed in 14442us (14582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.534923:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787359924.536391:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787359924.536409:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787359924.536420:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787359924.536427:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787359924.536430:0:3657:0:(import.c:65:import_set_state_nolock()) 000000002f17682f lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787359924.536450:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c53e9f1d): req@000000001f6af157 x1874182595949184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359924.536466:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595948672:0@lo:38: 00000100:00100000:0.0:1787359924.537918:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359924.537944:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595949696:0@lo:41: 00000100:00100000:0.0:1787359924.538027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.538184:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359924.543276:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949696 00000100:00100000:3.0:1787359924.543296:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949696 00000100:00100000:3.0:1787359924.543689:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949184 00000100:00100000:3.0:1787359924.543695:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949184 00000100:00100000:3.0:1787359924.543724:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787359924.543733:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a670d2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182595949696:12345-0@lo:41: 00000004:00000024:3.0:1787359924.543781:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787359924.543947:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359924.543959:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006591f5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7861:x1874182595949184:12345-0@lo:1000: 00000100:00100000:0.0:1787359924.545616:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c53e9f1d going to sleep for 11 seconds 00000100:00100000:3.0:1787359924.560026:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a670d2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182595949696:12345-0@lo:41: Request processed in 16286us (21992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359924.560042:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359924.560204:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595949696:0@lo:41: 00000100:00100000:0.0:1787359924.560294:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006591f5b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595949184:12345-0@lo:1000: Request processed in 16339us (22110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.560303:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359924.560377:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f6af157 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595949184:0@lo:1000: 00000040:01000000:1.0:1787359924.560456:0:7861:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787359924.561859:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595949824:0@lo:1000: 00000100:00100000:2.0:1787359924.561923:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359924.562641:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045299c39 going to sleep for 11 seconds 00000100:00100000:1.0:1787359924.571978:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949824 00000100:00100000:1.0:1787359924.571998:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949824 00000100:00100000:1.0:1787359924.572098:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787359924.572114:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e773efb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595949824:12345-0@lo:1000: 00000100:00100000:1.0:1787359924.572406:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e773efb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595949824:12345-0@lo:1000: Request processed in 296us (10481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359924.572416:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359924.572701:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595949824:0@lo:1000: 00000100:00100000:0.0:1787359924.572780:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595949952:0@lo:700: 00000100:00100000:0.0:1787359924.572904:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.572960:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595949952 00000100:00100000:0.0:1787359924.572966:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595949952 00000100:00100000:0.0:1787359924.573014:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359924.573481:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d72b1436 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595949952:12345-0@lo:700: 00000100:00100000:0.0:1787359924.573679:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d72b1436 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595949952:12345-0@lo:700: Request processed in 203us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.573687:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359924.573746:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be1978d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.573763:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595949952:0@lo:700: 00000100:00100000:0.0:1787359924.574000:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950080:0@lo:1000: 00000100:00100000:0.0:1787359924.574037:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.574060:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4a6548c going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.574079:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950080 00000100:00100000:0.0:1787359924.574085:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950080 00000100:00100000:0.0:1787359924.574118:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359924.574126:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d761135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595950080:12345-0@lo:1000: 00000100:00100000:0.0:1787359924.574189:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d761135 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595950080:12345-0@lo:1000: Request processed in 65us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.574196:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359924.574218:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950080:0@lo:1000: 00000004:00080000:0.0:1787359924.574834:0:7861:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000be1978d5 with version 0 00000020:00100000:0.0:1787359924.574852:0:7861:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787359924.574859:0:7861:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a8331fb6 x1874182595950336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787359924.574874:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950336:0@lo:1000: 00000100:00100000:0.0:1787359924.574916:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.574934:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aed8d766 going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.574949:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950336 00000100:00100000:0.0:1787359924.574953:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950336 00000100:00100000:0.0:1787359924.574977:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787359924.574983:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020a97f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7861:x1874182595950336:12345-0@lo:1000: 00000001:00080000:3.0:1787359924.577959:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1787359924.577984:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787359924.578189:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020a97f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7861:x1874182595950336:12345-0@lo:1000: Request processed in 3203us (3271us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787359924.578198:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1787359924.578308:0:7861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787359924.578314:0:7861:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787359924.578328:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950336:0@lo:1000: 00000100:00100000:0.0:1787359924.578414:0:7861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950464:0@lo:1000: 00000100:00100000:0.0:1787359924.578452:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.578475:0:7861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064a0b902 going to sleep for 11 seconds 00000100:00100000:0.0:1787359924.578494:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950464 00000100:00100000:0.0:1787359924.578500:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950464 00000100:00100000:0.0:1787359924.578530:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359924.578538:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f6af157 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7861:x1874182595950464:12345-0@lo:1000: 00000100:00100000:0.0:1787359924.578595:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f6af157 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7861:x1874182595950464:12345-0@lo:1000: Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.578602:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359924.578624:0:7861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7861:1874182595950464:0@lo:1000: 00000040:00080000:0.0:1787359924.578638:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787359924.578665:0:7861:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000be1978d5 with version 1 00000004:00080000:3.0:1787359924.579107:0:7859:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002a2e4977 version 1 rpc_version 1 00000020:00100000:3.0:1787359924.579125:0:7859:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787359924.579131:0:7859:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009fd7e95d x1874182595950720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787359924.579158:0:7859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e95d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7859:1874182595950720:0@lo:1000: 00000100:00100000:3.0:1787359924.579190:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359924.579208:0:7859:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009d14551 going to sleep for 11 seconds 00000100:00100000:3.0:1787359924.579221:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950720 00000100:00100000:3.0:1787359924.579533:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950720 00000100:00100000:3.0:1787359924.579560:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359924.579567:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b61224a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7859:x1874182595950720:12345-0@lo:1000: 00000040:00080000:0.0:1787359924.581062:0:7861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787359924.581138:0:7861:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787359924.581153:0:7861:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787359924.591021:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787359924.591394:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b61224a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7859:x1874182595950720:12345-0@lo:1000: Request processed in 11821us (12197us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787359924.591411:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1787359924.591528:0:7859:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787359924.591533:0:7859:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787359924.591553:0:7859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e95d pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7859:1874182595950720:0@lo:1000: 00000020:00000004:2.0:1787359924.949537:0:7892:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787359924.949774:0:7892:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787359925.369716:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787359926.004831:0:7940:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2df71650 20000000:00000080:2.0:1787359926.004849:0:7940:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a3ca1b000 uarg=0000000000000000 20000000:01000000:2.0:1787359926.004889:0:7940:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787359926.004897:0:7940:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787359926.004901:0:7940:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787359926.005023:0:7940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787359926.005035:0:7940:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787359926.009311:0:7940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359926.009997:0:7940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787359926.010034:0:7940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787359926.010054:0:7940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787359926.010072:0:7940:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787359926.010090:0:7940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010110:0:7940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010117:0:7940:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010123:0:7940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010164:0:7940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010177:0:7940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 17 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359926.010191:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7940:1874182595950848:0@lo:104: 00000100:00100000:2.0:1787359926.010502:0:7940:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359926.010566:0:7940:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.010575:0:7940:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 17 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359926.010583:0:7940:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7940:1874182595950976:0@lo:104: 00000100:00100000:2.0:1787359926.010602:0:7940:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2c2e37a going to sleep for 11 seconds 00000100:00100000:3.0:1787359926.010721:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787359926.010738:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359926.010764:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950848 00000100:00100000:3.0:1787359926.010771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950848 00000100:00100000:3.0:1787359926.010803:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595950976 00000100:00100000:3.0:1787359926.010816:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595950976 00000100:00100000:3.0:1787359926.010844:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359926.010852:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe13744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:7940:x1874182595950848:12345-0@lo:104: 00010000:00010000:3.0:1787359926.010862:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.010917:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359926.010922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe13744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:7940:x1874182595950848:12345-0@lo:104: Request processed in 72us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.010930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359926.010963:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359926.010969:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fda77c18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:7940:x1874182595950976:12345-0@lo:104: 00010000:00010000:3.0:1787359926.010976:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011019:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787359926.011023:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fda77c18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:7940:x1874182595950976:12345-0@lo:104: Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.011029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787359926.011046:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787359926.011050:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011056:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000bd7d0b0 already unused, calling callback (0000000010c5082c) 10000000:00010000:3.0:1787359926.011060:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011067:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359926.011074:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359926.011079:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787359926.011101:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011108:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359926.011124:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011130:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 000000000bd7d0b0/0x359a4e2aee71fc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc2e expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011151:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787359926.011153:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011159:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df329ab1 already unused, calling callback (0000000010c5082c) 10000000:00010000:3.0:1787359926.011161:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011166:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359926.011171:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359926.011175:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787359926.011189:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011194:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359926.011198:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011203:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fb39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fb40 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011215:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359926.011217:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359926.011218:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359926.011253:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aebdefe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951232:0@lo:103: 00000100:00100000:3.0:1787359926.011288:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359926.011310:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359926.011316:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd3c0f7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951104:0@lo:103: 00000100:00100000:3.0:1787359926.011336:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359926.011361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951232 00000100:00100000:3.0:1787359926.011365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951232 00010000:00010000:3.0:1787359926.011381:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 18 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359926.011400:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951104 00000100:00100000:3.0:1787359926.011402:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951104 00010000:00010000:3.0:1787359926.011412:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 19 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359926.011428:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359926.011434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8d816bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3659:x1874182595951232:12345-0@lo:103: 00010000:00010000:3.0:1787359926.011443:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359926.011448:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 19 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011455:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 19 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011535:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359926.011566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8d816bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3659:x1874182595951232:12345-0@lo:103: Request processed in 132us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.011571:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359926.011586:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359926.011591:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097b834b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595951104:12345-0@lo:103: 00010000:00010000:3.0:1787359926.011605:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359926.011609:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 18 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011617:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 18 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011626:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011633:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011644:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011650:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011655:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011660:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011665:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9471538 already unused, calling callback (000000006ae1db34) 00010000:00010000:3.0:1787359926.011668:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011674:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011691:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359926.011700:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359926.011722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097b834b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595951104:12345-0@lo:103: Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.011728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359926.011767:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd3c0f7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951104:0@lo:103: 00000100:00100000:3.0:1787359926.011775:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aebdefe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951232:0@lo:103: 00010000:00010000:1.0:1787359926.011966:0:7940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc27 expref: 17 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359926.011977:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046fe5902 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7940:1874182595950848:0@lo:104: 00010000:00010000:1.0:1787359926.011986:0:7940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000041896b4/0x359a4e2aee71fb40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fb39 expref: 16 pid: 6525 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359926.011993:0:7940:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea14d6d7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7940:1874182595950976:0@lo:104: 00010000:00010000:1.0:1787359926.012006:0:7940:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359926.012014:0:7940:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359926.012019:0:7940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359926.012024:0:7940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9471538/0x359a4e2aee71fcc1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359926.013565:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359926.394964:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359926.523186:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595951360:0@lo:41: 00000100:00100000:2.0:1787359926.523326:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359926.524471:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951360 00000100:00100000:1.0:1787359926.524482:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951360 00000100:00100000:1.0:1787359926.524531:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359926.524549:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050e2bb7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595951360:12345-0@lo:41: 00000004:00000024:1.0:1787359926.524581:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787359926.525013:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050e2bb7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595951360:12345-0@lo:41: Request processed in 464us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359926.525020:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787359926.526598:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011d5dd69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595951360:0@lo:41: 00010000:00010000:0.0:1787359927.418099:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359928.441416:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359929.478146:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359929.607124:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aebdefe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595951488:0@lo:41: 00000100:00100000:3.0:1787359929.607220:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085d91b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595951744:0@lo:400: 00000100:00100000:2.0:1787359929.607522:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359929.607570:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003588ac86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595952000:0@lo:400: 00000100:00100000:2.0:1787359929.607595:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359929.607617:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359929.607622:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000282a9804 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595951872:0@lo:400: 00000100:00100000:2.0:1787359929.607645:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359929.607678:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951488 00000100:00100000:2.0:1787359929.607685:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951488 00000100:00100000:2.0:1787359929.607725:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951872 00000100:00100000:2.0:1787359929.607728:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951872 00000100:00100000:2.0:1787359929.607743:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787359929.607751:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d5dd69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595951488:12345-0@lo:41: 00000004:00000024:2.0:1787359929.607810:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787359929.607857:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d5dd69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595951488:12345-0@lo:41: Request processed in 107us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359929.607865:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787359929.607885:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787359929.607891:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035fddb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595951872:12345-0@lo:400: 00000100:00100000:2.0:1787359929.607918:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035fddb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595951872:12345-0@lo:400: Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359929.607924:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787359929.608026:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359929.608049:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787359929.608055:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd3c0f7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951616:0@lo:400: 00000100:00100000:3.0:1787359929.608083:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359929.608104:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000266f67d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595952128:0@lo:400: 00000100:00100000:3.0:1787359929.608128:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359929.608164:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952000 00000100:00100000:3.0:1787359929.608168:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952000 00000100:00100000:3.0:1787359929.608192:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951744 00000100:00100000:3.0:1787359929.608194:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951744 00000100:00100000:3.0:1787359929.608207:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359929.608212:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aa8becf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595952000:12345-0@lo:400: 00000100:00100000:3.0:1787359929.608261:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aa8becf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595952000:12345-0@lo:400: Request processed in 49us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359929.608267:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359929.608287:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787359929.608304:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019e7a9ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595951744:12345-0@lo:400: 00000100:00100000:1.0:1787359929.608328:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952128 00000100:00100000:1.0:1787359929.608335:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952128 00000100:00100000:3.0:1787359929.608340:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019e7a9ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595951744:12345-0@lo:400: Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359929.608347:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359929.608359:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787359929.608366:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fd7e95d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595952128:12345-0@lo:400: 00000100:00100000:1.0:1787359929.608403:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fd7e95d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595952128:12345-0@lo:400: Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359929.608410:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787359929.608809:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595951616 00000100:00100000:3.0:1787359929.608814:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595951616 00000100:00100000:3.0:1787359929.608842:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787359929.608848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d0487aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595951616:12345-0@lo:400: 00000100:00100000:2.0:1787359929.609564:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000282a9804 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595951872:0@lo:400: 00000100:00100000:2.0:1787359929.609583:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aebdefe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595951488:0@lo:41: 00010000:00080000:2.0:1787359929.609596:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003588ac86 x1874182595952000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359929.609607:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003588ac86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595952000:0@lo:400: 00000100:00100000:3.0:1787359929.611852:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d0487aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595951616:12345-0@lo:400: Request processed in 2997us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359929.611870:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787359929.612495:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd3c0f7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595951616:0@lo:400: 00000100:00100000:3.0:1787359929.612514:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000266f67d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595952128:0@lo:400: 00010000:00080000:3.0:1787359929.612527:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000085d91b00 x1874182595951744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359929.612537:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085d91b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595951744:0@lo:400: 00010000:00010000:2.0:1787359930.489995:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359931.513544:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359931.651867:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595952256:0@lo:41: 00000100:00100000:1.0:1787359931.651962:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359931.652056:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952256 00000100:00100000:2.0:1787359931.652071:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952256 00000100:00100000:2.0:1787359931.652123:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359931.652134:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8130f92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595952256:12345-0@lo:41: 00000004:00000024:2.0:1787359931.652170:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1787359931.652301:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8130f92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595952256:12345-0@lo:41: Request processed in 170us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359931.652309:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359931.652363:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e43b16ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595952256:0@lo:41: 10000000:01000000:1.0:1787359932.153570:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787359932.153578:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a10f4d000 from 1 10000000:01000000:1.0:1787359932.153582:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359932.153622:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.153634:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.153644:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fcc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359932.153669:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952384:0@lo:101: 00000100:00100000:1.0:1787359932.153739:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359932.153805:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000290e086e going to sleep for 11 seconds 00000100:00100000:1.0:1787359932.153827:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952384 00000100:00100000:1.0:1787359932.153834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952384 00000100:00100000:1.0:1787359932.153889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787359932.153897:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e218403c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595952384:12345-0@lo:101: 00010000:00010000:1.0:1787359932.153908:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359932.153919:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fccf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fcc8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.153939:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.153948:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006dfc8730/0x359a4e2aee71fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.153956:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006dfc8730, rc 0) 00000100:00100000:1.0:1787359932.153988:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e218403c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595952384:12345-0@lo:101: Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.153995:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787359932.154036:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952384:0@lo:101: 00010000:00010000:1.0:1787359932.154048:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fcc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.154056:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: 00000000df329ab1/0x359a4e2aee71fcc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359932.154108:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952512:0@lo:501: 00000100:00100000:1.0:1787359932.154130:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359932.154141:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000290e086e going to sleep for 11 seconds 00000100:00100000:1.0:1787359932.154158:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952512 00000100:00100000:1.0:1787359932.154161:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952512 00000100:00100000:1.0:1787359932.154180:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359932.154186:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000216bff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595952512:12345-0@lo:501: 00000100:00100000:1.0:1787359932.154301:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000216bff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595952512:12345-0@lo:501: Request processed in 115us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.154308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359932.154333:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952512:0@lo:501: 00000100:00100000:1.0:1787359932.154373:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952640:0@lo:503: 00000100:00100000:1.0:1787359932.154410:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359932.154421:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set 00000000290e086e going to sleep for 11 seconds 00000100:00100000:1.0:1787359932.154431:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952640 00000100:00100000:1.0:1787359932.154435:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952640 00000100:00100000:1.0:1787359932.154453:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359932.154458:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005701081e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595952640:12345-0@lo:503: 00000100:00100000:1.0:1787359932.154529:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005701081e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595952640:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.154535:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359932.154570:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e60403 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595952640:0@lo:503: 00000100:00100000:0.0:1787359932.168043:0:8229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8229:1874182595952768:0@lo:502: 00000100:00100000:0.0:1787359932.168129:0:8229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359932.168174:0:8229:0:(client.c:2715:ptlrpc_set_wait()) set 000000007857b7d4 going to sleep for 11 seconds 00000100:00100000:1.0:1787359932.168979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952768 00000100:00100000:1.0:1787359932.168988:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952768 00000100:00100000:1.0:1787359932.169079:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359932.169089:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d718f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8229:x1874182595952768:12345-0@lo:502: 00000100:00100000:1.0:1787359932.169254:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d718f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8229:x1874182595952768:12345-0@lo:502: Request processed in 136us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.169262:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787359932.169371:0:8229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8331fb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8229:1874182595952768:0@lo:502: 00000020:01000000:0.0:1787359932.169410:0:8229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359932.169419:0:8229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359932.169421:0:8229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787359932.169428:0:8229:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a10f4d000 00000020:00000080:0.0:1787359932.169441:0:8229:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787359932.169482:0:8229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8229:1874182595952896:0@lo:502: 00000100:00100000:0.0:1787359932.169520:0:8229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359932.173267:0:8229:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359932.173571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595952896 00000100:00100000:3.0:1787359932.173581:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595952896 00000100:00100000:3.0:1787359932.173624:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787359932.173632:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8229:x1874182595952896:12345-0@lo:502: 00000100:00100000:3.0:1787359932.174006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8229:x1874182595952896:12345-0@lo:502: Request processed in 373us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359932.174015:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787359932.176078:0:8229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8229:1874182595952896:0@lo:502: 00000020:01000000:0.0:1787359932.176119:0:8229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359932.176127:0:8229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359932.176130:0:8229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787359932.176134:0:8229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787359932.177120:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787359932.177156:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359932.177167:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359932.177177:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359932.177186:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359932.177189:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a0ffaa800 from 1 10000000:01000000:2.0:1787359932.177191:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359932.177222:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359932.177246:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359932.177255:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359932.177275:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953024:0@lo:101: 00000100:00100000:2.0:1787359932.177336:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359932.177376:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fed6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787359932.177383:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953024 00000100:00100000:3.0:1787359932.177399:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953024 00000100:00100000:3.0:1787359932.177561:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787359932.177572:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595953024:12345-0@lo:101: 00010000:00010000:3.0:1787359932.177584:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359932.177597:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fcd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359932.177618:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359932.177629:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359932.177638:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517e00, rc 0) 00000100:00100000:3.0:1787359932.177683:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595953024:12345-0@lo:101: Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359932.177689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359932.177770:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953024:0@lo:101: 00010000:00010000:2.0:1787359932.177794:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359932.177804:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359932.177854:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953152:0@lo:501: 00000100:00100000:2.0:1787359932.177884:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359932.193150:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fed6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359932.193557:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953152 00000100:00100000:0.0:1787359932.193568:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953152 00000100:00100000:0.0:1787359932.193619:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787359932.193628:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595953152:12345-0@lo:501: 00000100:00100000:0.0:1787359932.193857:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595953152:12345-0@lo:501: Request processed in 230us (15972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359932.193866:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787359932.194665:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953152:0@lo:501: 00000100:00100000:1.0:1787359932.194719:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953280:0@lo:503: 00000100:00100000:1.0:1787359932.194859:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359932.194963:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359932.194979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953280 00000100:00100000:1.0:1787359932.194983:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953280 00000100:00100000:1.0:1787359932.195017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787359932.195025:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595953280:12345-0@lo:503: 00000100:00100000:1.0:1787359932.195123:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595953280:12345-0@lo:503: Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.195130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787359932.195169:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595953280:0@lo:503: 00000100:00100000:2.0:1787359932.202647:0:8235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8235:1874182595953408:0@lo:502: 00000100:00100000:2.0:1787359932.203930:0:8235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359932.204041:0:8235:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fed6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359932.204165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953408 00000100:00100000:0.0:1787359932.204173:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953408 00000100:00100000:0.0:1787359932.204250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787359932.204261:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8235:x1874182595953408:12345-0@lo:502: 00000100:00100000:0.0:1787359932.204413:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8235:x1874182595953408:12345-0@lo:502: Request processed in 153us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359932.204420:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359932.204499:0:8235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8235:1874182595953408:0@lo:502: 00000020:01000000:2.0:1787359932.204537:0:8235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359932.204546:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359932.204548:0:8235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787359932.204556:0:8235:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a0ffaa800 00000020:00000080:2.0:1787359932.204558:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787359932.204843:0:8235:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8235:1874182595953536:0@lo:502: 00000100:00100000:2.0:1787359932.204883:0:8235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359932.204958:0:8235:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fed6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359932.205449:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953536 00000100:00100000:3.0:1787359932.205456:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953536 00000100:00100000:3.0:1787359932.205494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787359932.205502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8235:x1874182595953536:12345-0@lo:502: 00000100:00100000:3.0:1787359932.205746:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8235:x1874182595953536:12345-0@lo:502: Request processed in 243us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359932.205753:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787359932.210523:0:8235:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8235:1874182595953536:0@lo:502: 00000020:01000000:2.0:1787359932.210569:0:8235:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359932.210577:0:8235:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359932.210815:0:8235:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787359932.210822:0:8235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787359932.211023:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787359932.211045:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359932.211055:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359932.211067:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359932.537348:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359933.563465:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359934.586540:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359934.715113:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595953664:0@lo:41: 00000100:00100000:1.0:1787359934.715179:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359934.719637:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595953920:0@lo:400: 00000100:00100000:0.0:1787359934.719696:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359934.719729:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359934.719735:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595954048:0@lo:400: 00000100:00100000:0.0:1787359934.719759:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359934.719801:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953920 00000100:00100000:0.0:1787359934.719808:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953920 00000100:00100000:0.0:1787359934.719849:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359934.719858:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595953920:12345-0@lo:400: 00000100:00100000:0.0:1787359934.719915:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595953920:12345-0@lo:400: Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359934.719921:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359934.719942:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953664 00000100:00100000:0.0:1787359934.719947:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953664 00000100:00100000:0.0:1787359934.720118:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954048 00000100:00100000:0.0:1787359934.720121:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954048 00000100:00100000:0.0:1787359934.720136:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787359934.720141:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595953664:12345-0@lo:41: 00000004:00000024:0.0:1787359934.720164:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787359934.720197:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595953664:12345-0@lo:41: Request processed in 55us (5018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359934.720203:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787359934.720214:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787359934.720220:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595954048:12345-0@lo:400: 00000100:00100000:0.0:1787359934.720271:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595954048:12345-0@lo:400: Request processed in 51us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359934.720277:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787359934.720311:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595954048:0@lo:400: 00010000:00080000:0.0:1787359934.720323:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2edded80 x1874182595953920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359934.720331:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595953920:0@lo:400: 00000100:00100000:0.0:1787359934.720355:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595953792:0@lo:400: 00000100:00100000:0.0:1787359934.720383:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359934.720408:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359934.720413:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595954176:0@lo:400: 00000100:00100000:0.0:1787359934.720453:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359934.720479:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595953792 00000100:00100000:0.0:1787359934.720482:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595953792 00000100:00100000:0.0:1787359934.720507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787359934.720883:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3661:x1874182595953792:12345-0@lo:400: 00000100:00100000:0.0:1787359934.720975:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3661:x1874182595953792:12345-0@lo:400: Request processed in 461us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359934.720982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787359934.721008:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954176 00000100:00100000:0.0:1787359934.721012:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954176 00000100:00100000:0.0:1787359934.721036:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359934.721042:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595954176:12345-0@lo:400: 00000100:00100000:0.0:1787359934.721084:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595954176:12345-0@lo:400: Request processed in 41us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359934.721090:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359934.721354:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595953664:0@lo:41: 00000100:00100000:2.0:1787359934.723090:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595953792:0@lo:400: 00010000:00080000:2.0:1787359934.723121:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2eddd500 x1874182595954176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359934.723133:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595954176:0@lo:400: 00010000:00010000:1.0:1787359935.622392:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787359936.232857:0:8441:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787359936.232861:0:8441:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787359936.232863:0:8441:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787359936.232966:0:8441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a3d61e800 00000020:01000004:1.0:1787359936.232981:0:8441:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787359936.232993:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787359936.233016:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff998a3505b370) 00000020:00000080:1.0:1787359936.233032:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787359936.288617:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787359936.288662:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1787359936.301755:0:8441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787359936.302186:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787359936.302198:0:8441:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787359936.302212:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee71fceb 00000020:01000004:1.0:1787359936.302219:0:8441:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787359936.302362:0:8441:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787359936.302366:0:8441:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787359936.302371:0:8441:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787359936.302377:0:8441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787359936.302387:0:8441:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff998a350599b8) 00000020:00000080:1.0:1787359936.302397:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1787359936.303748:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787359936.303905:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787359936.303911:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787359936.306139:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787359936.306150:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787359936.308733:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787359936.311064:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787359936.314740:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359936.315015:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787359936.315021:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787359936.318448:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787359936.318464:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787359936.346698:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359936.346926:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787359936.346932:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787359936.347940:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787359936.347947:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787359936.349131:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787359936.349142:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787359936.351382:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359936.351568:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787359936.351574:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787359936.352151:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787359936.352158:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787359936.398312:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359936.398610:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787359936.398618:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787359936.400574:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787359936.400588:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787359936.401058:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787359936.401089:0:8441:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787359936.401097:0:8441:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787359936.421060:0:8441:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787359936.421106:0:8441:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787359936.421111:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787359936.421112:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787359936.421113:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787359936.421114:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787359936.421115:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787359936.421117:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787359936.421118:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787359936.421120:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787359936.421121:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787359936.421122:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787359936.421124:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787359936.421127:0:8441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787359936.421129:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787359936.421131:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787359936.421137:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787359936.421138:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787359936.421138:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787359936.421139:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787359936.421140:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787359936.421141:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787359936.421142:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787359936.421143:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787359936.421144:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787359936.421172:0:8441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787359936.421192:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595954304:0@lo:253: 00000100:00100000:3.0:1787359936.421300:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.421495:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359936.421541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954304 00000100:00100000:2.0:1787359936.421550:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954304 00000100:00100000:2.0:1787359936.421651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787359936.421662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8441:x1874182595954304:12345-0@lo:253: 20000000:01000000:2.0:1787359936.421701:0:6524:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787359936.421705:0:6524:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787359936.421710:0:6524:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787359936.421713:0:6524:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787359936.421920:0:6524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359936.422053:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787359936.422068:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787359936.422099:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787359936.422108:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787359936.422122:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787359936.422137:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787359936.422218:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787359936.422268:0:6524:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:2.0:1787359936.422270:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787359936.422285:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787359936.422291:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787359936.422303:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787359936.422308:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1787359936.422318:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787359936.422323:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787359936.422334:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787359936.422347:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787359936.422405:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787359936.422630:0:6524:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:2.0:1787359936.422632:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787359936.422651:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787359936.422657:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787359936.422671:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787359936.422676:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1787359936.422689:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787359936.422695:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787359936.422707:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787359936.422722:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787359936.423607:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787359936.423625:0:6524:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:2.0:1787359936.423627:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:2.0:1787359936.423658:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787359936.423665:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787359936.423678:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787359936.423682:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:2.0:1787359936.423693:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787359936.423699:0:6524:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787359936.423711:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787359936.423725:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787359936.423737:0:6524:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787359936.423740:0:6524:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787359936.423743:0:6524:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787359936.423796:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787359936.423798:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787359936.424558:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787359936.424790:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787359936.424816:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787359936.424833:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787359936.424843:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787359936.424846:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787359936.425120:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1787359936.425138:0:8461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1787359936.425167:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787359936.425457:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787359936.425486:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787359936.425500:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1787359936.425507:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787359936.425509:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359936.425844:0:8462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359936.425868:0:8462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359936.425884:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787359936.426027:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787359936.426045:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787359936.426058:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787359936.426065:0:6524:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787359936.426067:0:6524:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787359936.426491:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1787359936.426512:0:8463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1787359936.426527:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787359936.426666:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787359936.426685:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787359936.426700:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1787359936.426715:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787359936.426735:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426754:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426761:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426781:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426788:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426794:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426813:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426849:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426861:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 18 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.426874:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954432:0@lo:104: 00000100:00100000:3.0:1787359936.426933:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359936.426986:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.426994:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 18 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.427003:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954560:0@lo:104: 00000100:00100000:3.0:1787359936.427024:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359936.427052:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.427060:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 18 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.427068:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954688:0@lo:104: 00000100:00100000:3.0:1787359936.427099:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359936.427117:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.427131:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 18 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.427139:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954816:0@lo:104: 00000100:00100000:3.0:1787359936.427160:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359936.427177:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.427185:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 18 pid: 6524 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.427193:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954944:0@lo:104: 00000100:00100000:3.0:1787359936.427212:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.427221:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359936.427329:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954432 00000100:00100000:0.0:1787359936.427336:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954432 00000100:00100000:0.0:1787359936.427371:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954560 00000100:00100000:0.0:1787359936.427374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954560 00000100:00100000:0.0:1787359936.427384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954688 00000100:00100000:0.0:1787359936.427386:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954688 00000100:00100000:0.0:1787359936.427395:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954816 00000100:00100000:0.0:1787359936.427397:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954816 00000100:00100000:0.0:1787359936.427406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595954944 00000100:00100000:0.0:1787359936.427478:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595954944 00000100:00100000:0.0:1787359936.427512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359936.427521:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6524:x1874182595954432:12345-0@lo:104: 00010000:00010000:0.0:1787359936.427534:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427598:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359936.427604:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6524:x1874182595954432:12345-0@lo:104: Request processed in 84us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.427611:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359936.427625:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359936.427631:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6524:x1874182595954560:12345-0@lo:104: 00010000:00010000:0.0:1787359936.427638:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427667:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787359936.427672:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6524:x1874182595954560:12345-0@lo:104: Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.427677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359936.427688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359936.427693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6524:x1874182595954688:12345-0@lo:104: 00010000:00010000:0.0:1787359936.427699:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427730:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787359936.427735:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6524:x1874182595954688:12345-0@lo:104: Request processed in 43us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.427740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359936.427751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359936.427775:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6524:x1874182595954816:12345-0@lo:104: 00010000:00010000:0.0:1787359936.427783:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427811:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787359936.427815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6524:x1874182595954816:12345-0@lo:104: Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.427821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359936.427833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359936.427838:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6524:x1874182595954944:12345-0@lo:104: 00010000:00010000:0.0:1787359936.427844:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427867:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787359936.427871:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6524:x1874182595954944:12345-0@lo:104: Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.427876:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787359936.427893:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787359936.427898:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427905:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.427909:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427917:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.427925:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.427936:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.427966:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427972:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.427990:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.427997:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fcb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428010:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787359936.428013:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428019:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.428022:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428029:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.428276:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.428282:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.428299:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428304:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.428335:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428342:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681800/0x359a4e2aee71fc89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc90 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428352:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787359936.428354:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428360:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.428363:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428370:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.428377:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.428382:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.428396:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428401:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.428406:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.428530:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954432:0@lo:104: 00000100:00100000:3.0:1787359936.428540:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954560:0@lo:104: 00000100:00100000:3.0:1787359936.428548:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954688:0@lo:104: 00000100:00100000:3.0:1787359936.428555:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954816:0@lo:104: 00000100:00100000:3.0:1787359936.428561:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6524:1874182595954944:0@lo:104: 00010000:00010000:3.0:1787359936.428586:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428628:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee71fc6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc74 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428637:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359936.428646:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428652:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.428655:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428663:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.428669:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.428674:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.428689:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428694:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.428701:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428706:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696c00/0x359a4e2aee71fc35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc3c expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428714:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359936.428717:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428722:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.428725:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428743:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.428750:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.428755:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.428780:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428786:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.428791:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428798:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fbbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fbc5 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.428811:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.428812:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.428814:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.428821:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.428826:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359936.428845:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955072:0@lo:103: 00000100:00100000:0.0:1787359936.428881:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.428918:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955584:0@lo:103: 00000100:00100000:0.0:1787359936.428938:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.428960:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359936.428966:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955456:0@lo:103: 00000100:00100000:0.0:1787359936.428996:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.429024:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595955328:0@lo:103: 00000100:00100000:0.0:1787359936.429052:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.429067:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359936.429072:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595955200:0@lo:103: 00000100:00100000:0.0:1787359936.429092:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.429112:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955072 00000100:00100000:0.0:1787359936.429117:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955072 00010000:00010000:0.0:1787359936.429138:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 19 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.429154:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955584 00000100:00100000:0.0:1787359936.429157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955584 00010000:00010000:0.0:1787359936.429166:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 20 pid: 6524 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.429177:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955456 00000100:00100000:0.0:1787359936.429180:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955456 00010000:00010000:0.0:1787359936.429188:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 21 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.429198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955328 00000100:00100000:0.0:1787359936.429200:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955328 00010000:00010000:0.0:1787359936.429210:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 22 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.429218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955200 00000100:00100000:0.0:1787359936.429220:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955200 00010000:00010000:0.0:1787359936.429269:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 23 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.429296:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359936.429304:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3661:x1874182595955072:12345-0@lo:103: 00010000:00010000:0.0:1787359936.429316:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359936.429320:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 23 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.429331:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 23 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.429344:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06680200/0x359a4e2aee71fcba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fcb3 expref: 23 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.429355:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359936.429385:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3661:x1874182595955072:12345-0@lo:103: Request processed in 82us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.429392:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359936.429404:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787359936.429518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359936.429528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3661:x1874182595955456:12345-0@lo:103: 00010000:00010000:2.0:1787359936.429537:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359936.429542:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 21 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429551:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 21 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429561:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688800/0x359a4e2aee71fc3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc35 expref: 21 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429570:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359936.429594:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3661:x1874182595955456:12345-0@lo:103: Request processed in 69us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.429600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359936.429612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359936.429617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3659:x1874182595955328:12345-0@lo:103: 00010000:00010000:2.0:1787359936.429632:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359936.429636:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 19 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429644:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 19 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429653:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696800/0x359a4e2aee71fc74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc6d expref: 19 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429661:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359936.429689:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595955328:12345-0@lo:103: Request processed in 71us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.429695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359936.429707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787359936.429713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:3659:x1874182595955200:12345-0@lo:103: 00010000:00010000:2.0:1787359936.429720:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359936.429724:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 17 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429732:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 17 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429742:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697e00/0x359a4e2aee71fc90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc89 expref: 17 pid: 6526 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.429750:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359936.429781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28ec0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595955200:12345-0@lo:103: Request processed in 68us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.429787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787359936.429820:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595955200:0@lo:103: 00000100:00100000:2.0:1787359936.429828:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595955328:0@lo:103: 00000100:00100000:0.0:1787359936.429980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3661:x1874182595955584:12345-0@lo:103: 00010000:00010000:0.0:1787359936.429990:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359936.429994:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 15 pid: 6524 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430003:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 15 pid: 6524 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430012:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689600/0x359a4e2aee71fbc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fbbe expref: 15 pid: 6524 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430034:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430042:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430056:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430063:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430070:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430076:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430081:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787359936.430085:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.430092:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.430294:0:6524:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.430302:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787359936.430316:0:6524:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787359936.432131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595954304:12345-0@lo:253: Request processed in 10464us (10824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.432145:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787359936.432261:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595954304:0@lo:253: 10000000:01000000:2.0:1787359936.432277:0:8441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787359936.432280:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787359936.432282:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787359936.432283:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359936.432284:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787359936.432286:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359936.432287:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359936.432289:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359936.432290:0:8441:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787359936.432292:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359936.432293:0:8441:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787359936.432316:0:8441:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a3d61e800 from lustre-OST0000 10000000:01000000:2.0:1787359936.432346:0:8441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787359936.432349:0:8441:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787359936.432356:0:8441:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a3bac8000 local copy 10000000:01000000:2.0:1787359936.432361:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787359936.432399:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.432423:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.432432:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359936.432450:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955712:0@lo:101: 00000100:00100000:2.0:1787359936.432503:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.432538:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06180 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.432651:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955712 00000100:00100000:1.0:1787359936.432658:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955712 00000100:00100000:1.0:1787359936.432700:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787359936.432709:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595955712:12345-0@lo:101: 00010000:00010000:1.0:1787359936.432721:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359936.432734:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd00 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.432755:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd00 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.432777:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd00 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.432786:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:1.0:1787359936.432820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595955712:12345-0@lo:101: Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.432839:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787359936.432917:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955712:0@lo:101: 00010000:00010000:3.0:1787359936.432929:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.432938:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.433017:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955840:0@lo:501: 00000100:00100000:3.0:1787359936.433043:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.433072:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.433114:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955840 00000100:00100000:1.0:1787359936.433120:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955840 00000100:00100000:1.0:1787359936.433151:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787359936.433157:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595955840:12345-0@lo:501: 00000100:00100000:1.0:1787359936.433213:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595955840:12345-0@lo:501: Request processed in 55us (168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359936.433219:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787359936.433357:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955840:0@lo:501: 10000000:01000000:3.0:1787359936.433369:0:8441:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787359936.433385:0:8441:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787359936.433390:0:8441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.433397:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.433404:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.433502:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787359936.433527:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a3d61e800 10000000:01000000:3.0:1787359936.433532:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787359936.433537:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787359936.433540:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787359936.433544:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787359936.433546:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787359936.433562:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.433569:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.433577:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.433588:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955968:0@lo:101: 00000100:00100000:3.0:1787359936.433613:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359936.433665:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359936.433672:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433679:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359936.433683:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433692:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359936.433699:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359936.433705:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359936.433723:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433729:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359936.433745:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433751:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fd07 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433773:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359936.433775:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359936.433777:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359936.433788:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595956096:0@lo:103: 00000100:00100000:2.0:1787359936.433814:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.433851:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956096 00000100:00100000:2.0:1787359936.433860:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956096 00000100:00100000:2.0:1787359936.433890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359936.433897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3658:x1874182595956096:12345-0@lo:103: 00010000:00010000:2.0:1787359936.433906:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359936.433919:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fd00 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.433931:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359936.433959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3658:x1874182595956096:12345-0@lo:103: Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.433966:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359936.433994:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595956096:0@lo:103: 00000100:00100000:3.0:1787359936.434058:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787359936.434212:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.434244:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516200/0x359a4e2aee71fcf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.434270:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359936.434301:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:3661:x1874182595955584:12345-0@lo:103: Request processed in 4891us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.434308:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359936.434357:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955456:0@lo:103: 00000100:00100000:0.0:1787359936.434366:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955072:0@lo:103: 00000100:00100000:0.0:1787359936.434373:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595955584:0@lo:103: 00000100:00100000:1.0:1787359936.434586:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595955968 00000100:00100000:1.0:1787359936.434592:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595955968 00000100:00100000:1.0:1787359936.434620:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787359936.434626:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+13:8441:x1874182595955968:12345-0@lo:101: 00010000:00010000:1.0:1787359936.434635:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359936.434647:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.434663:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.434672:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.434679:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689400, rc 0) 00000100:00100000:1.0:1787359936.434707:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595955968:12345-0@lo:101: Request processed in 81us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.434712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787359936.434827:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595955968:0@lo:101: 00010000:00010000:3.0:1787359936.434839:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.434847:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.434914:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956224:0@lo:501: 00000100:00100000:3.0:1787359936.434947:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.435000:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.435027:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956224 00000100:00100000:1.0:1787359936.435030:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956224 00000100:00100000:1.0:1787359936.435086:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787359936.435092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956224:12345-0@lo:501: 00000100:00100000:1.0:1787359936.435250:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956224:12345-0@lo:501: Request processed in 133us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.435256:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787359936.435463:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956224:0@lo:501: 00000100:00100000:0.0:1787359936.435491:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956352:0@lo:503: 00000100:00100000:0.0:1787359936.435526:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.435578:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.435605:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956352 00000100:00100000:1.0:1787359936.435609:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956352 00000100:00100000:1.0:1787359936.435636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787359936.435641:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956352:12345-0@lo:503: 00000100:00100000:1.0:1787359936.435705:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956352:12345-0@lo:503: Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.435711:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787359936.435788:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956352:0@lo:503: 00000040:00080000:0.0:1787359936.436001:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359936.436051:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956480:0@lo:502: 00000100:00100000:0.0:1787359936.436082:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.436102:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.436141:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956480 00000100:00100000:1.0:1787359936.436145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956480 00000100:00100000:1.0:1787359936.436170:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787359936.436176:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956480:12345-0@lo:502: 00000100:00100000:1.0:1787359936.436262:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956480:12345-0@lo:502: Request processed in 86us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.436269:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787359936.436339:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956480:0@lo:502: 00000040:00080000:0.0:1787359936.436574:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787359936.436596:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787359936.436607:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787359936.436617:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787359936.436628:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787359936.436639:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787359936.436655:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956608:0@lo:502: 00000100:00100000:0.0:1787359936.436689:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.436708:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe240 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.436746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956608 00000100:00100000:1.0:1787359936.436749:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956608 00000100:00100000:1.0:1787359936.436786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359936.436793:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956608:12345-0@lo:502: 00000100:00100000:1.0:1787359936.436846:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956608:12345-0@lo:502: Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.436852:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787359936.436914:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956608:0@lo:502: 00000040:00080000:0.0:1787359936.436944:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787359936.436950:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787359936.437582:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787359936.437591:0:8464:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787359936.437597:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359936.437598:0:8464:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787359936.437604:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359936.437618:0:8464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff998a28e4cd28) 00000020:00000080:3.0:1787359936.437637:0:8464:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787359936.437642:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787359936.437713:0:8464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61e800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787359936.437720:0:8464:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787359936.437726:0:8464:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee71fd23 00010000:00010000:3.0:1787359936.442834:0:8464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787359936.443980:0:8464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787359936.446643:0:8464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787359936.447022:0:8464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787359936.450899:0:8464:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787359936.451127:0:8464:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787359936.456096:0:8464:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787359936.459139:0:8464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787359936.459164:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359936.459172:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359936.459174:0:8464:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787359936.459178:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359936.459182:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359936.459184:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787359936.459187:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787359936.459189:0:8464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787359936.459217:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359936.459220:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359936.459221:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359936.459248:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787359936.461620:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787359936.461665:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787359936.461683:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.461696:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359936.461704:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61e800 from 1 10000000:01000000:2.0:1787359936.461707:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359936.461741:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.461748:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.461757:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359936.461795:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956736:0@lo:101: 00000100:00100000:2.0:1787359936.461857:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.461892:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.462034:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956736 00000100:00100000:1.0:1787359936.462041:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956736 00000100:00100000:1.0:1787359936.462087:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787359936.462096:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:8441:x1874182595956736:12345-0@lo:101: 00010000:00010000:1.0:1787359936.462107:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359936.462118:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd2a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.462151:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.462162:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.462170:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689600, rc 0) 00000100:00100000:1.0:1787359936.462212:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595956736:12345-0@lo:101: Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.462219:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787359936.462564:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956736:0@lo:101: 00010000:00010000:2.0:1787359936.462579:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.462588:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359936.462677:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956864:0@lo:501: 00000100:00100000:2.0:1787359936.462705:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.464369:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.465205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956864 00000100:00100000:1.0:1787359936.465395:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956864 00000100:00100000:1.0:1787359936.465552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787359936.465562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595956864:12345-0@lo:501: 00000100:00100000:1.0:1787359936.465717:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595956864:12345-0@lo:501: Request processed in 156us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.465724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787359936.465817:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956864:0@lo:501: 00000100:00100000:0.0:1787359936.465864:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956992:0@lo:503: 00000100:00100000:0.0:1787359936.465912:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.465995:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359936.466065:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595956992 00000100:00100000:2.0:1787359936.466071:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595956992 00000100:00100000:2.0:1787359936.466093:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787359936.466099:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595956992:12345-0@lo:503: 00000100:00100000:2.0:1787359936.466188:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595956992:12345-0@lo:503: Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.466194:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787359936.466290:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595956992:0@lo:503: 00000040:00080000:0.0:1787359936.466521:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359936.466581:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957120:0@lo:502: 00000100:00100000:0.0:1787359936.466617:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.466646:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359936.466755:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957120 00000100:00100000:2.0:1787359936.466760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957120 00000100:00100000:2.0:1787359936.466791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787359936.466796:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595957120:12345-0@lo:502: 00000100:00100000:2.0:1787359936.466878:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595957120:12345-0@lo:502: Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.466892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787359936.466963:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957120:0@lo:502: 00000040:00080000:0.0:1787359936.467131:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787359936.467154:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787359936.467172:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957248:0@lo:502: 00000100:00100000:0.0:1787359936.467203:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.467259:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359936.467322:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957248 00000100:00100000:2.0:1787359936.467327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957248 00000100:00100000:2.0:1787359936.467346:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787359936.467351:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595957248:12345-0@lo:502: 00000100:00100000:2.0:1787359936.467477:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595957248:12345-0@lo:502: Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.467483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787359936.467558:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957248:0@lo:502: 00000040:00080000:0.0:1787359936.467591:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787359936.467599:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787359936.468008:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359936.468015:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359936.468021:0:8468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787359936.468027:0:8468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3d61e800 00000020:00000080:0.0:1787359936.468029:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787359936.468041:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359936.468044:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359936.468045:0:8468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787359936.468047:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787359936.468152:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787359936.468171:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359936.468190:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.468201:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359936.468265:0:8441:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787359936.468268:0:8441:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a3d61e800 10000000:01000000:2.0:1787359936.468271:0:8441:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a3d61e800 10000000:01000000:2.0:1787359936.468276:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787359936.468281:0:8441:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a3d61e800 from 1 10000000:01000000:2.0:1787359936.468284:0:8441:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359936.468308:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.468317:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.468326:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359936.468345:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957376:0@lo:101: 00000100:00100000:2.0:1787359936.468374:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.468400:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.468497:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957376 00000100:00100000:1.0:1787359936.468503:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957376 00000100:00100000:1.0:1787359936.468533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787359936.468543:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8441:x1874182595957376:12345-0@lo:101: 00010000:00010000:1.0:1787359936.468552:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359936.468564:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd38 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.468584:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.468593:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359936.468603:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:1.0:1787359936.468834:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957376:12345-0@lo:101: Request processed in 292us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.468840:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787359936.468900:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957376:0@lo:101: 00010000:00010000:2.0:1787359936.468915:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359936.468923:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359936.468994:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957504:0@lo:501: 00000100:00100000:2.0:1787359936.469020:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.469081:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787359936.469112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957504 00000100:00100000:3.0:1787359936.469117:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957504 00000100:00100000:3.0:1787359936.469177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787359936.469186:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957504:12345-0@lo:501: 00000100:00100000:3.0:1787359936.469349:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957504:12345-0@lo:501: Request processed in 165us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.469356:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787359936.469436:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957504:0@lo:501: 00000100:00100000:2.0:1787359936.469461:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957632:0@lo:503: 00000100:00100000:2.0:1787359936.469503:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.469734:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.469804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957632 00000100:00100000:1.0:1787359936.469809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957632 00000100:00100000:1.0:1787359936.469829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787359936.469834:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957632:12345-0@lo:503: 00000100:00100000:1.0:1787359936.469917:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957632:12345-0@lo:503: Request processed in 81us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.469930:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787359936.470011:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957632:0@lo:503: 00000040:00080000:2.0:1787359936.470268:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787359936.470333:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957760:0@lo:502: 00000100:00100000:2.0:1787359936.470370:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.470389:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.470508:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957760 00000100:00100000:1.0:1787359936.470512:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957760 00000100:00100000:1.0:1787359936.470533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787359936.470539:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957760:12345-0@lo:502: 00000100:00100000:1.0:1787359936.470655:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957760:12345-0@lo:502: Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.470661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787359936.470903:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957760:0@lo:502: 00000040:00080000:2.0:1787359936.471118:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787359936.471151:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787359936.471166:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787359936.471180:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787359936.471192:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787359936.471204:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787359936.471218:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787359936.471337:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787359936.471352:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787359936.471363:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787359936.471375:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787359936.471386:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787359936.471398:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787359936.471489:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787359936.471508:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787359936.471521:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787359936.471535:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787359936.471547:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787359936.471561:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787359936.471592:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787359936.471608:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787359936.471621:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787359936.471634:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787359936.471647:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787359936.471658:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787359936.471671:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787359936.471684:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787359936.471698:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787359936.471713:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787359936.471727:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787359936.471741:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787359936.471755:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787359936.471781:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787359936.471795:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787359936.471817:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787359936.471843:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787359936.471859:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1787359936.471891:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957888:0@lo:502: 00000100:00100000:2.0:1787359936.471942:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.472026:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e35b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359936.472119:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595957888 00000100:00100000:1.0:1787359936.472125:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595957888 00000100:00100000:1.0:1787359936.472201:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787359936.472210:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957888:12345-0@lo:502: 00000100:00100000:1.0:1787359936.472740:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595957888:12345-0@lo:502: Request processed in 529us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.472749:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787359936.472873:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595957888:0@lo:502: 00000040:00080000:2.0:1787359936.472933:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787359936.472943:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787359936.473909:0:8469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787359936.473925:0:8469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff998a3c904d28) 00000020:00000080:0.0:1787359936.473950:0:8469:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787359936.474026:0:8469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787359936.474031:0:8469:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787359936.474033:0:8469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61e800 3 00010000:00080000:0.0:1787359936.474076:0:8469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99890263c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787359936.476599:0:8469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787359936.476846:0:8469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787359936.476887:0:8469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787359936.476898:0:8469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x359a4e2aee71fd4d 00000100:00080000:1.0:1787359936.476907:0:8469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359936.476913:0:8469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99890263c000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787359936.476946:0:8469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3c84ce00 x1874182595958016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787359936.476976:0:8469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787359936.477104:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182595958016:0@lo:38: 00000100:00100000:0.0:1787359936.477171:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359936.477319:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958016 00000100:00100000:1.0:1787359936.477327:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958016 00000100:00100000:1.0:1787359936.477374:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787359936.477381:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182595958016:12345-0@lo:38: 00010000:00080000:1.0:1787359936.477405:0:6533:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1787359936.477538:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x359a4e2aee71fd54 00000004:00100000:1.0:1787359936.477554:0:6533:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787359936.477582:0:6533:0:(import.c:65:import_set_state_nolock()) ffff998a2f240000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359936.477647:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874182595958016:12345-0@lo:38: Request processed in 263us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.477653:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787359936.477731:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3c84ce00 x1874182595958016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359936.477741:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787359936.477749:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787359936.477757:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787359936.477770:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787359936.477773:0:3657:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787359936.477779:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182595958016:0@lo:38: 00000100:00100000:2.0:1787359936.480682:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595958144:0@lo:400: 00000100:00100000:2.0:1787359936.480753:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.480840:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359936.480848:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595958528:0@lo:400: 00000100:00100000:2.0:1787359936.480874:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359936.480915:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958528 00000100:00100000:2.0:1787359936.480922:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958528 00000100:00100000:2.0:1787359936.480964:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359936.480973:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595958528:12345-0@lo:400: 00000100:00100000:2.0:1787359936.481028:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595958528:12345-0@lo:400: Request processed in 54us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.481034:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359936.481075:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595958528:0@lo:400: 00000100:00100000:0.0:1787359936.482393:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595958272:0@lo:400: 00000100:00100000:0.0:1787359936.482514:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.482548:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359936.482555:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595958400:0@lo:400: 00000100:00100000:0.0:1787359936.482590:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.482637:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958272 00000100:00100000:3.0:1787359936.482645:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958272 00000100:00100000:3.0:1787359936.482681:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787359936.482697:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595958272:12345-0@lo:400: 00000100:00100000:3.0:1787359936.482743:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595958272:12345-0@lo:400: Request processed in 48us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.482750:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:01000004:2.0:1787359936.483636:0:8469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787359936.483665:0:8469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99890273b370) 00000020:00000080:2.0:1787359936.483688:0:8469:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787359936.483796:0:8469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787359936.483800:0:8469:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787359936.483810:0:8469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61e800 3 00010000:00080000:2.0:1787359936.483839:0:8469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a2ed5b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.111@tcp at head 00000100:00100000:0.0:1787359936.490720:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595958272:0@lo:400: 00010000:00010000:2.0:1787359936.491017:0:8469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787359936.491251:0:8469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787359936.491290:0:8469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787359936.491301:0:8469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x359a4e2aee71fd62 00000100:00080000:2.0:1787359936.491309:0:8469:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787359936.491314:0:8469:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998a2ed5b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787359936.491349:0:8469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a0fc31880 x1874182595958656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787359936.491366:0:8469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787359936.491450:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182595958656:0@lo:38: 00000100:00100000:0.0:1787359936.491507:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359936.491597:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958144 00000100:00100000:1.0:1787359936.491604:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958144 00000100:00100000:1.0:1787359936.491652:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958400 00000100:00100000:1.0:1787359936.491656:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958400 00000100:00100000:1.0:1787359936.491674:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359936.491682:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595958144:12345-0@lo:400: 00000100:00100000:1.0:1787359936.491732:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595958144:12345-0@lo:400: Request processed in 51us (10980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.491739:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359936.491754:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359936.491759:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595958400:12345-0@lo:400: 00000100:00100000:1.0:1787359936.491806:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595958400:12345-0@lo:400: Request processed in 46us (9214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.491812:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787359936.491903:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3c9a1180 x1874182595958144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359936.491917:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595958144:0@lo:400: 00010000:00080000:0.0:1787359936.492176:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3c9a2300 x1874182595958400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359936.492186:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595958400:0@lo:400: 00000100:00100000:1.0:1787359936.494267:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958656 00000100:00100000:1.0:1787359936.494278:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958656 00000100:00100000:1.0:1787359936.494316:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359936.494324:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182595958656:12345-0@lo:38: 00010000:00080000:1.0:1787359936.494361:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1787359936.494391:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x359a4e2aee71fd69 00000004:00100000:1.0:1787359936.494537:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787359936.494568:0:6531:0:(import.c:65:import_set_state_nolock()) ffff998a2f245800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359936.494647:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874182595958656:12345-0@lo:38: Request processed in 321us (3139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.494655:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787359936.494737:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a0fc31880 x1874182595958656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359936.494748:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787359936.494754:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787359936.494761:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787359936.494779:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787359936.494782:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787359936.494787:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182595958656:0@lo:38: 00000040:00080000:2.0:1787359936.496857:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1787359936.497316:0:8441:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787359936.497343:0:8441:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359936.497366:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.497377:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787359936.497439:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787359936.497441:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787359936.497442:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359936.497448:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359936.497449:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359936.497450:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359936.497451:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787359936.497453:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359936.497454:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359936.497456:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359936.497457:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359936.497461:0:8441:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787359936.497463:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359936.497464:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787359936.497465:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359936.497466:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359936.497467:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359936.497468:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359936.497469:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787359936.497470:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359936.497471:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359936.497471:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359936.497472:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359936.497495:0:8441:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787359936.497513:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595958784:0@lo:253: 00000100:00100000:0.0:1787359936.497582:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.497618:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359936.497642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958784 00000100:00100000:0.0:1787359936.497649:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958784 00000100:00100000:0.0:1787359936.497689:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787359936.497697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595958784:12345-0@lo:253: 20000000:01000000:0.0:1787359936.497721:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787359936.497733:0:6525:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787359936.502068:0:6525:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787359936.502088:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787359936.502252:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787359936.502258:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787359936.502280:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502297:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502305:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502312:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502352:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502366:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 16 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.502379:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595958912:0@lo:104: 00000100:00100000:3.0:1787359936.502539:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359936.502592:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.502600:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 16 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.502620:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595959040:0@lo:104: 00000100:00100000:3.0:1787359936.502642:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46780 going to sleep for 11 seconds 00000100:00100000:0.0:1787359936.502697:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787359936.502715:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.502744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595958912 00000100:00100000:0.0:1787359936.502750:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595958912 00000100:00100000:0.0:1787359936.502792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959040 00000100:00100000:0.0:1787359936.502795:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959040 00000100:00100000:0.0:1787359936.502820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359936.502829:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595958912:12345-0@lo:104: 00010000:00010000:0.0:1787359936.502840:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.502888:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359936.502894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595958912:12345-0@lo:104: Request processed in 67us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.502901:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359936.502935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359936.502942:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595959040:12345-0@lo:104: 00010000:00010000:0.0:1787359936.502949:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.502980:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787359936.502985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595959040:12345-0@lo:104: Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.502990:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787359936.503007:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359936.503012:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503019:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.503023:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503031:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.503047:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.503052:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.503078:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503084:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.503101:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503108:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fc7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503119:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359936.503122:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503128:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359936.503131:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503137:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359936.503144:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359936.503149:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359936.503166:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503171:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359936.503184:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503190:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01517800/0x359a4e2aee71fc5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fc66 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503202:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.503204:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.503205:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359936.503211:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359936.503221:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595959168:0@lo:103: 00000100:00100000:0.0:1787359936.503275:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.503314:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595959296:0@lo:103: 00000100:00100000:0.0:1787359936.503337:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.503367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959168 00000100:00100000:0.0:1787359936.503371:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959168 00010000:00010000:0.0:1787359936.503389:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 17 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.503477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959296 00000100:00100000:0.0:1787359936.503481:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959296 00010000:00010000:0.0:1787359936.503494:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 18 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.503513:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359936.503520:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595959168:12345-0@lo:103: 00010000:00010000:0.0:1787359936.503539:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359936.503545:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 18 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503555:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 18 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503569:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359936.503597:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595959168:12345-0@lo:103: Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.503604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359936.503617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359936.503624:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:3660:x1874182595959296:12345-0@lo:103: 00010000:00010000:0.0:1787359936.503630:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359936.503635:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 17 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503644:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 17 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503655:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503663:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787359936.503675:0:6518:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004880570s 00010000:00010000:0.0:1787359936.503680:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503696:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503702:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503709:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503714:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787359936.503718:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503726:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503735:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359936.503744:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359936.503786:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:3660:x1874182595959296:12345-0@lo:103: Request processed in 163us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.503792:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359936.503827:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595959296:0@lo:103: 00000100:00100000:0.0:1787359936.503844:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595959168:0@lo:103: 00000100:00100000:2.0:1787359936.504001:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:8441:x1874182595958784:12345-0@lo:253: Request processed in 6304us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359936.504009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:3.0:1787359936.504109:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688600/0x359a4e2aee71fc82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc7b expref: 15 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.504120:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595958912:0@lo:104: 00010000:00010000:3.0:1787359936.504128:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06680000/0x359a4e2aee71fc66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fc5f expref: 14 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359936.504135:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595959040:0@lo:104: 00010000:00010000:3.0:1787359936.504148:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.504156:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.504163:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359936.504169:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359936.504282:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8441:1874182595958784:0@lo:253: 10000000:01000000:0.0:1787359936.504292:0:8441:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787359936.504301:0:8441:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787359936.504303:0:8441:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787359936.504305:0:8441:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359936.504306:0:8441:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359936.504307:0:8441:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359936.504309:0:8441:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359936.504310:0:8441:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787359936.504312:0:8441:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359936.504313:0:8441:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359936.504315:0:8441:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359936.504316:0:8441:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787359936.504325:0:8441:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787359936.511941:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787359936.512107:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787359936.512312:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787359936.514026:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787359936.514348:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787359936.515636:0:8441:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787359936.517175:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787359936.525937:0:8441:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787359936.525947:0:8441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787359936.525986:0:8441:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787359936.526027:0:8441:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787359936.526046:0:8441:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787359936.526063:0:8441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787359936.529692:0:8441:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359936.529915:0:8441:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787359936.648352:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359936.773459:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359936.773486:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595959424:0@lo:41: 00000100:00100000:0.0:1787359936.773553:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359936.780104:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959424 00000100:00100000:1.0:1787359936.780118:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959424 00000100:00100000:1.0:1787359936.780183:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359936.780194:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595959424:12345-0@lo:41: 00000004:00000024:1.0:1787359936.780249:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787359936.780326:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595959424:12345-0@lo:41: Request processed in 134us (6772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.780333:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359936.787611:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595959424:0@lo:41: 00000020:00000004:1.0:1787359937.364767:0:8525:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787359937.364988:0:8525:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787359937.659456:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359938.682011:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359939.706002:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359939.835588:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595959552:0@lo:41: 00000100:00100000:1.0:1787359939.835690:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359939.836339:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959552 00000100:00100000:2.0:1787359939.836351:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959552 00000100:00100000:2.0:1787359939.836475:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787359939.836488:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595959552:12345-0@lo:41: 00000004:00000024:2.0:1787359939.836535:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787359939.836609:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595959552:12345-0@lo:41: Request processed in 123us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359939.836618:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359939.837503:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595959552:0@lo:41: 00010000:00010000:0.0:1787359940.729784:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359941.756789:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359941.883577:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359941.883809:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595959680:0@lo:41: 00000100:00100000:0.0:1787359941.883882:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359941.884497:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959680 00000100:00100000:2.0:1787359941.884507:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959680 00000100:00100000:2.0:1787359941.884557:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787359941.884566:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595959680:12345-0@lo:41: 00000004:00000024:2.0:1787359941.884600:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1787359941.884649:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595959680:12345-0@lo:41: Request processed in 84us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359941.884656:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359941.884666:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595959808:0@lo:400: 00000100:00100000:3.0:1787359941.884700:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359941.884753:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182595960320:0@lo:400: 00000100:00100000:3.0:1787359941.884781:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359941.884801:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787359941.884806:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595959936:0@lo:400: 00000100:00100000:3.0:1787359941.884827:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359941.884844:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595960448:0@lo:400: 00000100:00100000:2.0:1787359941.884854:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959808 00000100:00100000:2.0:1787359941.884858:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959808 00000100:00100000:3.0:1787359941.884866:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359941.884882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787359941.884889:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3660:x1874182595959808:12345-0@lo:400: 00000100:00100000:3.0:1787359941.884890:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595960192:0@lo:400: 00000100:00100000:3.0:1787359941.884913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359941.884920:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:3660:x1874182595959808:12345-0@lo:400: Request processed in 32us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359941.884927:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787359941.884928:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359941.884933:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182595960064:0@lo:400: 00000100:00100000:3.0:1787359941.884954:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359941.884973:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960320 00000100:00100000:3.0:1787359941.884977:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960320 00000100:00100000:3.0:1787359941.885014:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595959936 00000100:00100000:3.0:1787359941.885017:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595959936 00000100:00100000:3.0:1787359941.885025:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960448 00000100:00100000:3.0:1787359941.885027:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960448 00000100:00100000:3.0:1787359941.885038:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960064 00000100:00100000:3.0:1787359941.885040:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960064 00000100:00100000:3.0:1787359941.885051:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359941.885056:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182595960320:12345-0@lo:400: 00000100:00100000:3.0:1787359941.885083:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182595960320:12345-0@lo:400: Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.885089:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359941.885100:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359941.885106:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595959936:12345-0@lo:400: 00000100:00100000:3.0:1787359941.885131:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595959936:12345-0@lo:400: Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.885143:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359941.885156:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359941.885162:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595960448:12345-0@lo:400: 00000100:00080000:2.0:1787359941.885166:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359941.885170:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359941.885190:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595960448:12345-0@lo:400: Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.885196:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359941.885208:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359941.885213:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182595960064:12345-0@lo:400: 00000100:00100000:3.0:1787359941.885274:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182595960064:12345-0@lo:400: Request processed in 61us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.885279:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359941.885301:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960192 00000100:00100000:3.0:1787359941.885304:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960192 00000100:00100000:3.0:1787359941.885325:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359941.885330:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595960192:12345-0@lo:400: 00000100:00100000:3.0:1787359941.885358:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595960192:12345-0@lo:400: Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.885363:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787359941.885482:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a1180 x1874182595960064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359941.885496:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182595960064:0@lo:400: 00000100:00100000:2.0:1787359941.885506:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595960192:0@lo:400: 00010000:00080000:2.0:1787359941.885795:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3100 x1874182595959936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359941.885805:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595959936:0@lo:400: 00010000:00080000:2.0:1787359941.885818:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3480 x1874182595960448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359941.885839:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595960448:0@lo:400: 00000100:00100000:2.0:1787359941.885850:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595959808:0@lo:400: 00010000:00080000:2.0:1787359941.885862:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a1c00 x1874182595960320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359941.885869:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182595960320:0@lo:400: 00000100:00100000:3.0:1787359941.886489:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595959680:0@lo:41: 10000000:01000000:2.0:1787359942.396763:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787359942.396770:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a10f4d000 from 30 10000000:01000000:2.0:1787359942.396776:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359942.396822:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.396833:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.396844:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.396868:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960576:0@lo:101: 00000100:00100000:2.0:1787359942.396934:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.397007:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.397519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960576 00000100:00100000:3.0:1787359942.397528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960576 00000100:00100000:3.0:1787359942.397582:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787359942.397591:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:6528:x1874182595960576:12345-0@lo:101: 00010000:00010000:3.0:1787359942.397604:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359942.397618:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd77 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.397663:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.397672:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.397680:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:3.0:1787359942.397745:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595960576:12345-0@lo:101: Request processed in 155us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.397752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787359942.397847:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960576:0@lo:101: 00010000:00010000:1.0:1787359942.397862:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.397879:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.397959:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960704:0@lo:501: 00000100:00100000:1.0:1787359942.397988:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.398016:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.398386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960704 00000100:00100000:3.0:1787359942.398391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960704 00000100:00100000:3.0:1787359942.398429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787359942.398437:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595960704:12345-0@lo:501: 00000100:00100000:3.0:1787359942.398543:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595960704:12345-0@lo:501: Request processed in 106us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.398549:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787359942.398750:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960704:0@lo:501: 00000100:00100000:1.0:1787359942.398781:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960832:0@lo:503: 00000100:00100000:1.0:1787359942.398823:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.398852:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.398904:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960832 00000100:00100000:3.0:1787359942.398908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960832 00000100:00100000:3.0:1787359942.398954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787359942.398961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595960832:12345-0@lo:503: 00000100:00100000:3.0:1787359942.399539:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595960832:12345-0@lo:503: Request processed in 577us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.399547:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787359942.399856:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595960832:0@lo:503: 00000100:00100000:1.0:1787359942.401826:0:8760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8760:1874182595960960:0@lo:502: 00000100:00100000:1.0:1787359942.401898:0:8760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.401949:0:8760:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996480 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.402132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595960960 00000100:00100000:3.0:1787359942.402138:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595960960 00000100:00100000:3.0:1787359942.402184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787359942.402201:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8760:x1874182595960960:12345-0@lo:502: 00000100:00100000:3.0:1787359942.402345:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8760:x1874182595960960:12345-0@lo:502: Request processed in 145us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.402352:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787359942.403171:0:8760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8760:1874182595960960:0@lo:502: 00000100:00100000:1.0:1787359942.404094:0:8760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8760:1874182595961088:0@lo:502: 00000100:00100000:1.0:1787359942.404163:0:8760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.404193:0:8760:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996480 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.405166:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961088 00000100:00100000:3.0:1787359942.405175:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961088 00000100:00100000:3.0:1787359942.405265:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787359942.405275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8760:x1874182595961088:12345-0@lo:502: 00000100:00100000:3.0:1787359942.405408:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:8760:x1874182595961088:12345-0@lo:502: Request processed in 134us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.405416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787359942.405581:0:8760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8760:1874182595961088:0@lo:502: 00000040:00080000:2.0:1787359942.405615:0:8760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787359942.405825:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787359942.405845:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787359942.405854:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.405865:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359942.405874:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787359942.405876:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a10f4d000 from 5 10000000:01000000:3.0:1787359942.405879:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787359942.405910:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.405929:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.406485:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359942.406515:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961216:0@lo:101: 00000100:00100000:3.0:1787359942.406561:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.406588:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec480 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.406646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961216 00000100:00100000:1.0:1787359942.406653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961216 00000100:00100000:1.0:1787359942.406693:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787359942.406701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595961216:12345-0@lo:101: 00010000:00010000:1.0:1787359942.406712:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.406727:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd85 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.406764:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.406773:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.406781:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688800, rc 0) 00000100:00100000:1.0:1787359942.406826:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595961216:12345-0@lo:101: Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.406831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787359942.406904:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961216:0@lo:101: 00010000:00010000:2.0:1787359942.406916:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.406946:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.406995:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961344:0@lo:256: 00000100:00100000:2.0:1787359942.407028:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.407259:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.407361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961344 00000100:00100000:1.0:1787359942.407366:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961344 00000100:00100000:1.0:1787359942.407401:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787359942.407407:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595961344:12345-0@lo:256: 20000000:01000000:1.0:1787359942.407421:0:6525:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787359942.407436:0:6525:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787359942.407439:0:6525:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787359942.407521:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595961344:12345-0@lo:256: Request processed in 113us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.407528:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787359942.407559:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961344:0@lo:256: 10000000:01000000:1.0:1787359942.407604:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787359942.407611:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407618:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359942.407636:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787359942.407637:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1787359942.407640:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787359942.407658:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407666:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407672:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.407685:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961472:0@lo:101: 00000100:00100000:1.0:1787359942.407710:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.407741:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.407754:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961472 00000100:00100000:1.0:1787359942.407757:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961472 00000100:00100000:1.0:1787359942.407774:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787359942.407780:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595961472:12345-0@lo:101: 00010000:00010000:1.0:1787359942.407788:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.407798:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fd93 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407813:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407821:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407839:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688600, rc 0) 00000100:00100000:1.0:1787359942.407868:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595961472:12345-0@lo:101: Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.407873:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787359942.407901:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961472:0@lo:101: 00010000:00010000:1.0:1787359942.407911:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.407919:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.411320:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961600:0@lo:501: 00000100:00100000:1.0:1787359942.411397:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.411443:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.412079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961600 00000100:00100000:3.0:1787359942.412089:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961600 00000100:00100000:3.0:1787359942.412148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787359942.412159:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595961600:12345-0@lo:501: 00000100:00100000:3.0:1787359942.417357:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595961600:12345-0@lo:501: Request processed in 5192us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.417371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787359942.417433:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961600:0@lo:501: 00000100:00100000:3.0:1787359942.417479:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961728:0@lo:503: 00000100:00100000:3.0:1787359942.417524:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.417560:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec240 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.420171:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961728 00000100:00100000:3.0:1787359942.420185:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961728 00000100:00100000:3.0:1787359942.420324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787359942.420336:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595961728:12345-0@lo:503: 00000100:00100000:3.0:1787359942.420487:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595961728:12345-0@lo:503: Request processed in 153us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.420493:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787359942.420552:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595961728:0@lo:503: 00000100:00100000:3.0:1787359942.420799:0:8761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8761:1874182595961856:0@lo:502: 00000100:00100000:3.0:1787359942.420841:0:8761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.420870:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961856 00000100:00100000:3.0:1787359942.420874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961856 00000100:00100000:3.0:1787359942.420896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787359942.420903:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8761:x1874182595961856:12345-0@lo:502: 00000100:00100000:3.0:1787359942.424222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8761:x1874182595961856:12345-0@lo:502: Request processed in 3310us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.425387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787359942.425461:0:8761:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec180 going to sleep for 11 seconds 00000100:00100000:3.0:1787359942.425486:0:8761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8761:1874182595961856:0@lo:502: 00000020:01000000:3.0:1787359942.425528:0:8761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787359942.425536:0:8761:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787359942.425543:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359942.425545:0:8761:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787359942.425549:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787359942.425553:0:8761:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1787359942.425587:0:8761:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787359942.425590:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359942.425605:0:8761:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff998a28e48000) 00000020:00000080:3.0:1787359942.425628:0:8761:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1787359942.425633:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787359942.425716:0:8761:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787359942.425722:0:8761:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787359942.425750:0:8761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71fda8 00010000:00080000:3.0:1787359942.425781:0:8761:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9989029fd800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787359942.427164:0:8761:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787359942.465147:0:8761:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787359942.465170:0:8761:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787359942.465438:0:8761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359942.465639:0:8761:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359942.465719:0:8761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787359942.465816:0:8761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787359942.467008:0:8764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787359942.467013:0:8764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787359942.468049:0:8761:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787359942.468063:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787359942.468102:0:8761:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787359942.468124:0:8761:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fdaf 00000100:00080000:0.0:1787359942.468135:0:8761:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787359942.468141:0:8761:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9989029fd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787359942.468175:0:8761:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddfb80 x1874182595961984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787359942.468289:0:8761:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787359942.468475:0:8761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359942.468479:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359942.468481:0:8761:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787359942.468484:0:8761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359942.468487:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359942.468489:0:8761:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787359942.468492:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787359942.468493:0:8761:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359942.468520:0:8761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8761:1874182595962112:0@lo:502: 00000100:00100000:0.0:1787359942.468602:0:8761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.468642:0:8761:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.468777:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595961984:0@lo:8: 00000100:00100000:1.0:1787359942.468813:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.468849:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595961984 00000100:00100000:3.0:1787359942.468856:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595961984 00000100:00100000:3.0:1787359942.468889:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359942.468897:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1874182595961984:12345-0@lo:8: 00000100:00100000:2.0:1787359942.469111:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962112 00000100:00100000:2.0:1787359942.469116:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962112 00000100:00100000:2.0:1787359942.469157:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787359942.469164:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8761:x1874182595962112:12345-0@lo:502: 00000100:00100000:2.0:1787359942.469517:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:8761:x1874182595962112:12345-0@lo:502: Request processed in 352us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.469524:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1787359942.470056:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1787359942.470088:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fdb6 00002000:00100000:3.0:1787359942.470127:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9989029ff800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787359942.470132:0:8447:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1787359942.470136:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787359942.470201:0:8447:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787359942.470700:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787359942.470728:0:8447:0:(import.c:65:import_set_state_nolock()) ffff9989029f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359942.470808:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182595961984:12345-0@lo:8: Request processed in 1910us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.470817:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359942.470871:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2eddfb80 x1874182595961984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359942.470882:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787359942.470889:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787359942.470896:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787359942.470901:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787359942.470903:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989029fd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787359942.470926:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:0.0:1787359942.472430:0:8764:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787359942.472500:0:8764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 220719273768ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787359942.472507:0:8764:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787359942.472907:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595961984:0@lo:8: 00000100:00100000:1.0:1787359942.473882:0:8761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8761:1874182595962112:0@lo:502: 00000020:01000000:1.0:1787359942.473918:0:8761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359942.473925:0:8761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359942.473927:0:8761:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359942.473930:0:8761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1787359942.474058:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1787359942.474081:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787359942.474091:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.474101:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.474101:0:8765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595962240:0@lo:700: 10000000:01000000:2.0:1787359942.474113:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787359942.474116:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a0ffaa800 from 30 10000000:01000000:2.0:1787359942.474118:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359942.474141:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.474147:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.474159:0:8765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359942.474161:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.474173:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962368:0@lo:101: 00000100:00100000:1.0:1787359942.474185:0:8765:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.474201:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.474638:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962240 00000100:00100000:0.0:1787359942.474646:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962240 00000100:00100000:0.0:1787359942.474698:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359942.474708:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8765:x1874182595962240:12345-0@lo:700: 00000100:00100000:0.0:1787359942.474753:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1874182595962496:0@lo:700: 00000100:00100000:0.0:1787359942.474786:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787359942.474924:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359942.474938:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962496 00000100:00100000:1.0:1787359942.474948:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962496 00000100:00100000:1.0:1787359942.474974:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787359942.474981:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1874182595962496:12345-0@lo:700: 00000100:00100000:2.0:1787359942.475385:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.475404:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962368 00000100:00100000:2.0:1787359942.475409:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962368 00000100:00100000:2.0:1787359942.475439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787359942.475446:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595962368:12345-0@lo:101: 00010000:00010000:2.0:1787359942.475455:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359942.475468:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fdbd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.475488:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.475497:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.475505:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696600, rc 0) 00000100:00100000:2.0:1787359942.475552:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595962368:12345-0@lo:101: Request processed in 106us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.475559:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787359942.475604:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962368:0@lo:101: 00010000:00010000:2.0:1787359942.475618:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.475638:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.476155:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.476163:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962624:0@lo:501: 00000100:00100000:2.0:1787359942.476205:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.476252:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.476265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962624 00000100:00100000:2.0:1787359942.476269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962624 00000100:00100000:2.0:1787359942.476296:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787359942.476303:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595962624:12345-0@lo:501: 00000100:00100000:2.0:1787359942.476404:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595962624:12345-0@lo:501: Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.476411:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787359942.476442:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962624:0@lo:501: 00000100:00100000:2.0:1787359942.476468:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962752:0@lo:503: 00000100:00100000:2.0:1787359942.476511:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.476527:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.476539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962752 00000100:00100000:2.0:1787359942.476542:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962752 00000100:00100000:2.0:1787359942.476564:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787359942.476570:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595962752:12345-0@lo:503: 00000100:00100000:2.0:1787359942.476645:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595962752:12345-0@lo:503: Request processed in 75us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.476652:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787359942.476704:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595962752:0@lo:503: 00000100:00100000:1.0:1787359942.479012:0:8766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8766:1874182595962880:0@lo:502: 00000100:00100000:1.0:1787359942.479103:0:8766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.479141:0:8766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.479365:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595962880 00000100:00100000:2.0:1787359942.479373:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595962880 00000100:00100000:2.0:1787359942.479414:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787359942.479422:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8766:x1874182595962880:12345-0@lo:502: 00000100:00100000:2.0:1787359942.479542:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8766:x1874182595962880:12345-0@lo:502: Request processed in 119us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.479549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787359942.479591:0:8766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8766:1874182595962880:0@lo:502: 00000100:00100000:1.0:1787359942.479638:0:8766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8766:1874182595963008:0@lo:502: 00000100:00100000:1.0:1787359942.479669:0:8766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.479696:0:8766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.479776:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963008 00000100:00100000:2.0:1787359942.479781:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963008 00000100:00100000:2.0:1787359942.479813:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787359942.479821:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8766:x1874182595963008:12345-0@lo:502: 00000100:00100000:2.0:1787359942.479891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:8766:x1874182595963008:12345-0@lo:502: Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.479897:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787359942.479908:0:8766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8766:1874182595963008:0@lo:502: 00000040:00080000:1.0:1787359942.479924:0:8766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787359942.480379:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787359942.480400:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359942.480410:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.480421:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359942.480430:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787359942.480433:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a0ffaa800 from 5 10000000:01000000:2.0:1787359942.480435:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787359942.480460:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.480468:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.480483:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.480498:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963136:0@lo:101: 00000100:00100000:2.0:1787359942.480530:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.480560:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.480602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963136 00000100:00100000:1.0:1787359942.480607:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963136 00000100:00100000:1.0:1787359942.480639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787359942.480647:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595963136:12345-0@lo:101: 00010000:00010000:1.0:1787359942.480656:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.480668:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fdcb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.480688:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.480696:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.480715:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00031800, rc 0) 00000100:00100000:1.0:1787359942.480765:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595963136:12345-0@lo:101: Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.480771:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787359942.481183:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963136:0@lo:101: 00010000:00010000:0.0:1787359942.481198:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.481208:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359942.481282:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963264:0@lo:256: 00000100:00100000:0.0:1787359942.481316:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.481343:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.481398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963264 00000100:00100000:2.0:1787359942.481403:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963264 00000100:00100000:2.0:1787359942.481440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787359942.481448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595963264:12345-0@lo:256: 20000000:01000000:2.0:1787359942.481462:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787359942.481479:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787359942.481482:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787359942.481562:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595963264:12345-0@lo:256: Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.481569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787359942.481598:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963264:0@lo:256: 10000000:01000000:2.0:1787359942.481642:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787359942.481647:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481654:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359942.481661:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787359942.481663:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787359942.481665:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787359942.481687:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481694:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481700:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.481712:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963392:0@lo:101: 00000100:00100000:2.0:1787359942.481749:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.481764:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.481774:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963392 00000100:00100000:2.0:1787359942.481777:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963392 00000100:00100000:2.0:1787359942.481797:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787359942.481803:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595963392:12345-0@lo:101: 00010000:00010000:2.0:1787359942.481809:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359942.481819:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fdd9 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481833:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481842:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481848:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787359942.481875:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595963392:12345-0@lo:101: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.481881:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787359942.481918:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963392:0@lo:101: 00010000:00010000:2.0:1787359942.481928:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.481935:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.481979:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963520:0@lo:501: 00000100:00100000:2.0:1787359942.482001:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.482013:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.482023:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963520 00000100:00100000:2.0:1787359942.482026:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963520 00000100:00100000:2.0:1787359942.482061:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787359942.482068:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595963520:12345-0@lo:501: 00000100:00100000:2.0:1787359942.482356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595963520:12345-0@lo:501: Request processed in 287us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.482362:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787359942.482393:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963520:0@lo:501: 00000100:00100000:2.0:1787359942.482419:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963648:0@lo:503: 00000100:00100000:2.0:1787359942.482456:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.482474:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.482485:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963648 00000100:00100000:2.0:1787359942.482488:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963648 00000100:00100000:2.0:1787359942.482509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787359942.482516:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595963648:12345-0@lo:503: 00000100:00100000:2.0:1787359942.482587:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595963648:12345-0@lo:503: Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.482601:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787359942.482637:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595963648:0@lo:503: 00000004:00080000:0.0:1787359942.486130:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1787359942.487858:0:6538:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787359942.488795:0:8767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8767:1874182595963776:0@lo:502: 00000100:00100000:2.0:1787359942.488877:0:8767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.488913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963776 00000100:00100000:2.0:1787359942.488920:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963776 00000100:00100000:2.0:1787359942.488962:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787359942.488971:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:8767:x1874182595963776:12345-0@lo:502: 00000100:00100000:2.0:1787359942.489098:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:8767:x1874182595963776:12345-0@lo:502: Request processed in 126us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.489106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787359942.489159:0:8767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.489179:0:8767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8767:1874182595963776:0@lo:502: 00000020:01000000:2.0:1787359942.489453:0:8767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787359942.489460:0:8767:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787359942.489467:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359942.489469:0:8767:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787359942.489474:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787359942.489479:0:8767:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:2.0:1787359942.489501:0:8767:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787359942.489504:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787359942.489520:0:8767:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9989027399b8) 00000020:00000080:2.0:1787359942.489544:0:8767:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787359942.489550:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787359942.489648:0:8767:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787359942.489653:0:8767:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787359942.489665:0:8767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71fdee 00010000:00080000:2.0:1787359942.489695:0:8767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a2ed5f800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787359942.489930:0:8767:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1787359942.500847:0:8767:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787359942.500873:0:8767:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787359942.501479:0:8767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359942.501704:0:8767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359942.501837:0:8767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787359942.501921:0:8767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787359942.502874:0:8768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359942.502880:0:8768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1787359942.504748:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1874182595962496:12345-0@lo:700: Request processed in 29750us (29944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.504763:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787359942.504826:0:8456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2eddc380 x1874182595962496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359942.504842:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1874182595962496:0@lo:700: 40000000:02000000:1.0:1787359942.504856:0:8456:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:3.0:1787359942.509575:0:8767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787359942.509590:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787359942.509636:0:8767:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787359942.509661:0:8767:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71fdf5 00000100:00080000:3.0:1787359942.509672:0:8767:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359942.509678:0:8767:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff998a2ed5f800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787359942.509717:0:8767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3c9a2680 x1874182595963904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787359942.509772:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595963904:0@lo:8: 00000100:00100000:3.0:1787359942.509836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787359942.509890:0:8767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787359942.512382:0:8767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359942.512407:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359942.512409:0:8767:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787359942.512413:0:8767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359942.512417:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359942.512419:0:8767:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787359942.512422:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787359942.513126:0:8767:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787359942.513196:0:8767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8767:1874182595964032:0@lo:502: 00000100:00100000:3.0:1787359942.513674:0:8767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.513708:0:8767:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.513865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964032 00000100:00100000:2.0:1787359942.513872:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964032 00000100:00100000:2.0:1787359942.513918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787359942.513927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:8767:x1874182595964032:12345-0@lo:502: 00000100:00100000:2.0:1787359942.514075:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:8767:x1874182595964032:12345-0@lo:502: Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.514082:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787359942.514372:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595963904 00000100:00100000:2.0:1787359942.514378:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595963904 00000100:00100000:2.0:1787359942.514402:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359942.514407:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3657:x1874182595963904:12345-0@lo:8: 00010000:00080000:2.0:1787359942.514433:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1787359942.514463:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71fdfc 00002000:00100000:2.0:1787359942.514478:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff998a3c9c4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787359942.514482:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787359942.514485:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787359942.514553:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787359942.514600:0:8450:0:(import.c:65:import_set_state_nolock()) ffff998902a5b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359942.514647:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182595963904:12345-0@lo:8: Request processed in 238us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.514654:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787359942.514705:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595963904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359942.514717:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787359942.514725:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787359942.514742:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787359942.514748:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787359942.514750:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787359942.514760:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787359942.514766:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595963904:0@lo:8: 00000004:00080000:2.0:1787359942.514797:0:8768:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787359942.514839:0:8768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 220761612110ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787359942.514845:0:8768:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787359942.515657:0:8767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:8767:1874182595964032:0@lo:502: 00000020:01000000:3.0:1787359942.515687:0:8767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359942.515693:0:8767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359942.515695:0:8767:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787359942.515700:0:8767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787359942.516367:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787359942.516389:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787359942.516399:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516410:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359942.516421:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787359942.516423:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a3bac8000 from 1 10000000:01000000:2.0:1787359942.516426:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787359942.516455:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516473:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516483:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.516513:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595964160:0@lo:101: 00000100:00100000:2.0:1787359942.516567:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.516599:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.516617:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964160 00000100:00100000:2.0:1787359942.516622:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964160 00000100:00100000:2.0:1787359942.516670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787359942.516679:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595964160:12345-0@lo:101: 00010000:00010000:2.0:1787359942.516690:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359942.516702:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe03 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516722:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516745:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516754:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696c00, rc 0) 00000100:00100000:2.0:1787359942.516788:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595964160:12345-0@lo:101: Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.516794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787359942.516833:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595964160:0@lo:101: 00010000:00010000:2.0:1787359942.516852:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.516861:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.516913:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595964288:0@lo:501: 00000100:00100000:2.0:1787359942.516937:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.516949:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787359942.516961:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964288 00000100:00100000:2.0:1787359942.516964:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964288 00000100:00100000:2.0:1787359942.516985:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787359942.516991:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595964288:12345-0@lo:501: 00000100:00100000:2.0:1787359942.517053:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595964288:12345-0@lo:501: Request processed in 62us (115us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359942.517060:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787359942.517102:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595964288:0@lo:501: 10000000:01000000:2.0:1787359942.517122:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787359942.517127:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.517135:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787359942.521603:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787359942.527764:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595964416:0@lo:13: 00000100:00100000:2.0:1787359942.527835:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787359942.527902:0:8769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787359942.527929:0:8769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964544:0@lo:7: 00000100:00100000:3.0:1787359942.527960:0:8769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.527991:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964544 00000100:00100000:3.0:1787359942.527998:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964544 00000100:00100000:3.0:1787359942.528074:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359942.528083:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8769:x1874182595964544:12345-0@lo:7: 00000100:00100000:0.0:1787359942.528489:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964416 00000100:00100000:0.0:1787359942.528494:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964416 00000100:00100000:0.0:1787359942.528524:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359942.528531:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182595964416:12345-0@lo:13: 00002000:00000024:0.0:1787359942.528549:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00080000:1.0:1787359942.530781:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359942.532104:0:8769:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.533802:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182595964416:12345-0@lo:13: Request processed in 5263us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.533815:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787359942.538691:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2d80 x1874182595964416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359942.538728:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595964416:0@lo:13: 00002000:00080000:1.0:1787359942.544138:0:8447:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787359942.544147:0:8447:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787359942.544287:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8769:x1874182595964544:12345-0@lo:7: Request processed in 16193us (16314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.544304:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787359942.544350:0:8769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595964544/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359942.544364:0:8769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964544:0@lo:7: 00000004:00080000:3.0:1787359942.544390:0:8769:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787359942.544425:0:8769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964672:0@lo:5: 00000100:00100000:3.0:1787359942.544460:0:8769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.544493:0:8769:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.545503:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964672 00000100:00100000:1.0:1787359942.545513:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964672 00000100:00100000:1.0:1787359942.545555:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787359942.545565:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8769:x1874182595964672:12345-0@lo:5: 00002000:00080000:1.0:1787359942.545592:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787359942.545595:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00100000:2.0:1787359942.548061:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787359942.548081:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787359942.548652:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595962240:12345-0@lo:700: Request processed in 73940us (74486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.548668:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787359942.549507:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c84e680 x1874182595962240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359942.549538:0:8765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595962240:0@lo:700: 00000001:00080000:2.0:1787359942.550578:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787359942.550970:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8769:x1874182595964672:12345-0@lo:5: Request processed in 5403us (6506us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787359942.550981:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787359942.551083:0:8769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595964672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359942.551094:0:8769:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787359942.551099:0:8769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964672:0@lo:5: 00000004:00080000:2.0:1787359942.551111:0:8769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787359942.551153:0:8769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964800:0@lo:700: 00000100:00100000:2.0:1787359942.551193:0:8769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.551242:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964800 00000100:00100000:2.0:1787359942.551249:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964800 00000100:00100000:2.0:1787359942.551287:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359942.551296:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8769:x1874182595964800:12345-0@lo:700: 00000100:00100000:2.0:1787359942.551420:0:8769:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.561017:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8769:x1874182595964800:12345-0@lo:700: Request processed in 9714us (9816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.561031:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787359942.561300:0:8769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a0fc31880 x1874182595964800/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359942.561315:0:8769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595964800:0@lo:700: 00000004:02000040:1.0:1787359942.563759:0:8769:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000004:00080000:0.0:1787359942.565898:0:8765:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787359942.565934:0:8765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965056:0@lo:7: 00000100:00100000:0.0:1787359942.566028:0:8765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.566071:0:8765:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.566089:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595964928:0@lo:13: 00000100:00100000:0.0:1787359942.566115:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.566151:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595964928 00000100:00100000:0.0:1787359942.566158:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595964928 00000100:00100000:0.0:1787359942.566201:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359942.566210:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595964928:12345-0@lo:13: 00002000:00000024:0.0:1787359942.566253:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:0.0:1787359942.566293:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595964928:12345-0@lo:13: Request processed in 84us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.566300:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359942.566339:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2edddc00 x1874182595964928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.566356:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595964928:0@lo:13: 00000100:00100000:0.0:1787359942.566383:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965056 00000100:00100000:0.0:1787359942.566387:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965056 00000100:00100000:0.0:1787359942.566415:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359942.566422:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595965056:12345-0@lo:7: 00000100:00100000:1.0:1787359942.573545:0:8769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595965184:0@lo:5: 00000100:00100000:1.0:1787359942.573627:0:8769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.573675:0:8448:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787359942.573683:0:8448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787359942.573789:0:8769:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996840 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.575963:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965184 00000100:00100000:1.0:1787359942.575975:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965184 00000100:00100000:3.0:1787359942.576146:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787359942.576158:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8769:x1874182595965184:12345-0@lo:5: 00002000:00080000:0.0:1787359942.580316:0:8450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787359942.580325:0:8450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787359942.580410:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595965056:12345-0@lo:7: Request processed in 13984us (14378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.580420:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787359942.580470:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2eddf480 x1874182595965056/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.580492:0:8765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965056:0@lo:7: 00000004:00080000:0.0:1787359942.580506:0:8765:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787359942.580542:0:8765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965312:0@lo:5: 00000100:00100000:0.0:1787359942.580575:0:8765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.580599:0:8765:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.580616:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965312 00000100:00100000:0.0:1787359942.580622:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965312 00000100:00100000:0.0:1787359942.580656:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359942.580664:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595965312:12345-0@lo:5: 00002000:00080000:0.0:1787359942.580687:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787359942.580716:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595965312:12345-0@lo:5: Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.580721:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787359942.580759:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2eddf480 x1874182595965312/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.580769:0:8765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965312:0@lo:5: 00000004:00080000:0.0:1787359942.580780:0:8765:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787359942.580801:0:8765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965440:0@lo:5: 00000100:00100000:0.0:1787359942.580821:0:8765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.580833:0:8765:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.580843:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965440 00000100:00100000:0.0:1787359942.580847:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965440 00000100:00100000:0.0:1787359942.580867:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787359942.580873:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8765:x1874182595965440:12345-0@lo:5: 00002000:00080000:0.0:1787359942.580892:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:3.0:1787359942.582949:0:8770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787359942.582971:0:8770:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1787359942.589976:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8765:x1874182595965440:12345-0@lo:5: Request processed in 9096us (9147us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787359942.589989:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787359942.592388:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2eddf480 x1874182595965440/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.592411:0:8765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8765:1874182595965440:0@lo:5: 00000004:00080000:0.0:1787359942.592439:0:8765:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787359942.592513:0:8765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8765:1874182595965568:0@lo:900: 00000100:00100000:0.0:1787359942.592573:0:8765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.592603:0:8765:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.592628:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965568 00000100:00100000:0.0:1787359942.592634:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965568 00000100:00100000:0.0:1787359942.592677:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359942.592685:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8765:x1874182595965568:12345-0@lo:900: 00000100:00100000:0.0:1787359942.592744:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8765:x1874182595965568:12345-0@lo:900: Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.592751:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359942.592786:0:8765:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914e00 x1874182595965568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.592797:0:8765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8765:1874182595965568:0@lo:900: 00000100:00100000:1.0:1787359942.593416:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8769:x1874182595965184:12345-0@lo:5: Request processed in 17260us (19787us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787359942.593433:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787359942.594693:0:8769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c84e680 x1874182595965184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359958 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.594712:0:8769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8769:1874182595965184:0@lo:5: 00000004:00080000:0.0:1787359942.594726:0:8769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1787359942.779202:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359943.383150:0:8824:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787359943.809626:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787359944.551713:0:8876:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359944.552007:0:8876:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787359944.831330:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359944.954313:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359944.954339:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595965696:0@lo:41: 00000100:00100000:1.0:1787359944.954421:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359944.954893:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965696 00000100:00100000:2.0:1787359944.954907:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965696 00000100:00100000:2.0:1787359944.954979:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787359944.954992:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595965696:12345-0@lo:41: 00000004:00000024:2.0:1787359944.955036:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787359944.955122:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595965696:12345-0@lo:41: Request processed in 133us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359944.955130:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359944.956304:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595965696:0@lo:41: 00000001:00080000:2.0:1787359945.502000:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1787359945.502017:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787359945.849943:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359946.873447:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359947.004888:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595965824:0@lo:41: 00000100:00100000:1.0:1787359947.004957:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359947.005053:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965824 00000100:00100000:0.0:1787359947.005070:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965824 00000100:00100000:0.0:1787359947.005116:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359947.005125:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595965824:12345-0@lo:41: 00000004:00000024:0.0:1787359947.005156:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787359947.009023:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595965824:12345-0@lo:41: Request processed in 3887us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359947.009040:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787359947.009144:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595965824:0@lo:41: 00000020:00000004:0.0:1787359947.501893:0:8977:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359947.502122:0:8977:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787359947.514493:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595966208:0@lo:400: 00000100:00100000:3.0:1787359947.514559:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359947.514606:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595966720:0@lo:400: 00000100:00100000:3.0:1787359947.514630:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359947.514656:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787359947.514662:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595966336:0@lo:400: 00000100:00100000:3.0:1787359947.514685:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.514858:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595965952:0@lo:400: 00000100:00100000:1.0:1787359947.514892:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.514912:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182595966464:0@lo:400: 00000100:00100000:1.0:1787359947.514932:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.514951:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787359947.514956:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595966080:0@lo:400: 00000100:00100000:1.0:1787359947.514975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.514990:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182595966592:0@lo:400: 00000100:00100000:1.0:1787359947.515010:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.515047:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966208 00000100:00100000:1.0:1787359947.515054:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966208 00000100:00100000:1.0:1787359947.515089:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966464 00000100:00100000:1.0:1787359947.515091:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966464 00000100:00100000:1.0:1787359947.515113:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966080 00000100:00100000:1.0:1787359947.515116:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966080 00000100:00100000:1.0:1787359947.515127:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966592 00000100:00100000:1.0:1787359947.515129:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966592 00000100:00100000:1.0:1787359947.515146:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359947.515153:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595966208:12345-0@lo:400: 00000100:00100000:1.0:1787359947.515197:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595966208:12345-0@lo:400: Request processed in 44us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.515203:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359947.515221:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359947.515243:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182595966464:12345-0@lo:400: 00000100:00100000:1.0:1787359947.515274:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182595966464:12345-0@lo:400: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.515280:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359947.515304:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359947.515309:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595966080:12345-0@lo:400: 00000100:00100000:1.0:1787359947.515337:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595966080:12345-0@lo:400: Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.515342:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359947.515424:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787359947.515432:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182595966592:12345-0@lo:400: 00000100:00100000:1.0:1787359947.515460:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182595966592:12345-0@lo:400: Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.515466:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787359947.515486:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787359947.515490:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787359947.515515:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3480 x1874182595966080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.515528:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595966080:0@lo:400: 00010000:00080000:1.0:1787359947.515538:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595966592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.515546:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182595966592:0@lo:400: 00010000:00080000:1.0:1787359947.515554:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a1180 x1874182595966464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.515562:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182595966464:0@lo:400: 00000100:00100000:2.0:1787359947.515650:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595965952 00000100:00100000:2.0:1787359947.515656:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595965952 00000100:00100000:0.0:1787359947.515829:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966720 00000100:00100000:0.0:1787359947.515834:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966720 00000100:00100000:0.0:1787359947.515868:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359947.515875:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595966720:12345-0@lo:400: 00000100:00100000:0.0:1787359947.515914:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595966720:12345-0@lo:400: Request processed in 40us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359947.515920:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359947.516171:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787359947.516181:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182595965952:12345-0@lo:400: 00000100:00100000:2.0:1787359947.516253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182595965952:12345-0@lo:400: Request processed in 74us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359947.516260:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787359947.516476:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595966848:0@lo:400: 00000100:00100000:3.0:1787359947.516506:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787359947.516533:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3100 x1874182595966208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359947.516544:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595966208:0@lo:400: 00010000:00080000:3.0:1787359947.516567:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2d80 x1874182595966720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359947.516573:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787359947.516584:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595966720:0@lo:400: 00000100:00100000:1.0:1787359947.517492:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966336 00000100:00100000:1.0:1787359947.517502:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966336 00000100:00100000:1.0:1787359947.517546:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359947.517554:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595966336:12345-0@lo:400: 00000100:00100000:1.0:1787359947.517622:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595966336:12345-0@lo:400: Request processed in 68us (2935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.517629:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359947.517664:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595966336:0@lo:400: 00000100:00100000:0.0:1787359947.518498:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966848 00000100:00100000:0.0:1787359947.518506:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966848 00000100:00100000:2.0:1787359947.526418:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595965952:0@lo:400: 00000100:00100000:2.0:1787359947.535479:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359947.535500:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595966848:12345-0@lo:400: 00000100:00100000:2.0:1787359947.535583:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595966848:12345-0@lo:400: Request processed in 92us (19075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359947.535590:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787359947.543390:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a35056d80 x1874182595966848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.543404:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787359947.543421:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595966848:0@lo:400: 00000100:00080000:1.0:1787359947.543445:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787359947.897378:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359948.025763:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359948.025788:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595966976:0@lo:13: 00000100:00100000:0.0:1787359948.025855:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359948.025932:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595966976 00000100:00100000:0.0:1787359948.025953:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595966976 00000100:00100000:0.0:1787359948.026255:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359948.026265:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595966976:12345-0@lo:13: 00002000:00000024:0.0:1787359948.026292:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359948.026334:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595966976:12345-0@lo:13: Request processed in 71us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359948.026341:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787359948.026486:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914e00 x1874182595966976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359948.026503:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595966976:0@lo:13: 00000100:00100000:3.0:1787359948.028643:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359948.028665:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595967104:0@lo:13: 00000100:00100000:3.0:1787359948.028733:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359948.030264:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967104 00000100:00100000:0.0:1787359948.030276:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967104 00000100:00100000:0.0:1787359948.030337:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359948.030347:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595967104:12345-0@lo:13: 00002000:00000024:0.0:1787359948.030385:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359948.030462:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595967104:12345-0@lo:13: Request processed in 116us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359948.030470:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787359948.030612:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914e00 x1874182595967104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359948.030633:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595967104:0@lo:13: 00000020:00000004:0.0:1787359948.481816:0:9025:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359948.481829:0:9025:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787359948.921444:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359949.945502:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359950.074271:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359950.074307:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595967232:0@lo:41: 00000100:00100000:2.0:1787359950.074396:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359950.074469:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967232 00000100:00100000:3.0:1787359950.074480:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967232 00000100:00100000:3.0:1787359950.074552:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787359950.074563:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595967232:12345-0@lo:41: 00000004:00000024:3.0:1787359950.074605:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787359950.074678:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595967232:12345-0@lo:41: Request processed in 116us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359950.074685:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359950.074913:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595967232:0@lo:41: 00010000:00010000:1.0:1787359950.969843:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359951.994587:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359952.134102:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595967360:0@lo:41: 00000100:00100000:1.0:1787359952.134171:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.134263:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967360 00000100:00100000:1.0:1787359952.134270:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967360 00000100:00100000:1.0:1787359952.134315:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359952.134323:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595967360:12345-0@lo:41: 00000004:00000024:1.0:1787359952.134356:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787359952.134402:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595967360:12345-0@lo:41: Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.136021:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359952.136094:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595967360:0@lo:41: 00000100:00100000:3.0:1787359952.634429:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595967488:0@lo:400: 00000100:00100000:3.0:1787359952.634497:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359952.634629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967488 00000100:00100000:0.0:1787359952.634637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967488 00000100:00100000:0.0:1787359952.634692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787359952.634702:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182595967488:12345-0@lo:400: 00000100:00100000:2.0:1787359952.634929:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595967616:0@lo:400: 00000100:00100000:2.0:1787359952.634961:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359952.634988:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595968128:0@lo:400: 00000100:00100000:2.0:1787359952.635008:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359952.635093:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182595967488:12345-0@lo:400: Request processed in 392us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359952.635101:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787359952.635175:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595967744:0@lo:400: 00000100:00100000:1.0:1787359952.635206:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595967872:0@lo:400: 00000100:00100000:1.0:1787359952.635244:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.635278:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595968384:0@lo:400: 00000100:00100000:1.0:1787359952.635301:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359952.635362:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967872 00000100:00100000:0.0:1787359952.635367:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967872 00000100:00100000:0.0:1787359952.635397:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787359952.635404:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595967872:12345-0@lo:400: 00000100:00100000:0.0:1787359952.635443:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595967872:12345-0@lo:400: Request processed in 40us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359952.635449:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787359952.635531:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359952.635538:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595968000:0@lo:400: 00000100:00100000:2.0:1787359952.635559:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359952.636970:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595967488:0@lo:400: 00000100:00100000:0.0:1787359952.637505:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.637625:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967616 00000100:00100000:1.0:1787359952.637631:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967616 00000100:00100000:1.0:1787359952.637667:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968128 00000100:00100000:1.0:1787359952.637670:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968128 00000100:00100000:1.0:1787359952.637712:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968000 00000100:00100000:1.0:1787359952.637715:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968000 00000100:00100000:1.0:1787359952.637733:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787359952.637740:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595967616:12345-0@lo:400: 00000100:00100000:1.0:1787359952.637806:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595967616:12345-0@lo:400: Request processed in 65us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.637813:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787359952.637831:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787359952.637837:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595968128:12345-0@lo:400: 00000100:00100000:1.0:1787359952.637865:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595968128:12345-0@lo:400: Request processed in 28us (2856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.637871:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787359952.637885:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787359952.637891:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595968000:12345-0@lo:400: 00000100:00100000:1.0:1787359952.637916:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595968000:12345-0@lo:400: Request processed in 26us (2356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.637922:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787359952.637942:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968384 00000100:00100000:1.0:1787359952.637947:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968384 00000100:00100000:1.0:1787359952.637971:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787359952.637977:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595968384:12345-0@lo:400: 00000100:00100000:1.0:1787359952.638005:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595968384:12345-0@lo:400: Request processed in 29us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.638033:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787359952.638069:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5ce00 x1874182595968000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359952.638083:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595968000:0@lo:400: 00010000:00080000:1.0:1787359952.638094:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5df80 x1874182595967616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359952.638103:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595967616:0@lo:400: 00010000:00080000:1.0:1787359952.638112:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5ca80 x1874182595968128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359952.638120:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595968128:0@lo:400: 00000100:00100000:1.0:1787359952.638154:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595967872:0@lo:400: 00010000:00080000:1.0:1787359952.638163:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5c380 x1874182595968384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359952.638171:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595968384:0@lo:400: 00000100:00080000:2.0:1787359952.638219:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359952.638247:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359952.638249:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787359952.638436:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595968256:0@lo:400: 00000100:00100000:0.0:1787359952.638472:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359952.638545:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968256 00000100:00100000:2.0:1787359952.638549:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968256 00000100:00100000:2.0:1787359952.638588:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359952.638595:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595968256:12345-0@lo:400: 00000100:00100000:2.0:1787359952.638630:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595968256:12345-0@lo:400: Request processed in 35us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359952.638636:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787359952.638696:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787359952.638713:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5f800 x1874182595968256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359952.638723:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595968256:0@lo:400: 00000100:00100000:1.0:1787359952.638773:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595967744 00000100:00100000:1.0:1787359952.638777:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595967744 00000100:00100000:1.0:1787359952.638811:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359952.638817:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595967744:12345-0@lo:400: 00000100:00100000:1.0:1787359952.638857:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595967744:12345-0@lo:400: Request processed in 40us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.638863:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787359952.638913:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5e300 x1874182595967744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359952.638923:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595967744:0@lo:400: 00010000:00010000:1.0:1787359953.020142:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359953.146978:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359953.147001:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595968512:0@lo:13: 00000100:00100000:2.0:1787359953.147074:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359953.147285:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968512 00000100:00100000:1.0:1787359953.147304:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968512 00000100:00100000:1.0:1787359953.147377:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359953.147387:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595968512:12345-0@lo:13: 00002000:00000024:1.0:1787359953.147413:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359953.147458:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595968512:12345-0@lo:13: Request processed in 73us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359953.147466:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787359953.147514:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a1f80 x1874182595968512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359953.147532:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595968512:0@lo:13: 00000100:00100000:1.0:1787359953.151793:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595968640:0@lo:13: 00000100:00100000:1.0:1787359953.151884:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359953.152266:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968640 00000100:00100000:2.0:1787359953.152273:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968640 00000100:00100000:2.0:1787359953.152548:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359953.152561:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595968640:12345-0@lo:13: 00002000:00000024:2.0:1787359953.153704:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359953.153807:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595968640:12345-0@lo:13: Request processed in 1248us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359953.153827:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787359953.161920:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a2ee5ea00 x1874182595968640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359953.161946:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595968640:0@lo:13: 00010000:00010000:0.0:1787359954.050128:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359955.068347:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359955.195490:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595968768:0@lo:41: 00000100:00100000:0.0:1787359955.195564:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359955.195687:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968768 00000100:00100000:3.0:1787359955.195696:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968768 00000100:00100000:3.0:1787359955.195752:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359955.195763:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595968768:12345-0@lo:41: 00000004:00000024:3.0:1787359955.195805:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787359955.195859:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595968768:12345-0@lo:41: Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359955.195866:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359955.195923:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595968768:0@lo:41: 00010000:00010000:1.0:1787359956.093473:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359957.117939:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359957.242675:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359957.242702:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595968896:0@lo:41: 00000100:00100000:0.0:1787359957.242774:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.242914:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595968896 00000100:00100000:1.0:1787359957.242923:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595968896 00000100:00100000:1.0:1787359957.242977:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787359957.242986:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595968896:12345-0@lo:41: 00000004:00000024:1.0:1787359957.243116:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787359957.243410:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595968896:12345-0@lo:41: Request processed in 423us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.243420:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787359957.243446:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595968896:0@lo:41: 00000100:00100000:1.0:1787359957.753831:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595969280:0@lo:400: 00000100:00100000:1.0:1787359957.753896:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.753949:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595969792:0@lo:400: 00000100:00100000:1.0:1787359957.753976:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754018:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787359957.754024:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595969408:0@lo:400: 00000100:00100000:1.0:1787359957.754046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754061:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595969920:0@lo:400: 00000100:00100000:1.0:1787359957.754078:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754116:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969280 00000100:00100000:1.0:1787359957.754123:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969280 00000100:00100000:1.0:1787359957.754166:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359957.754175:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595969280:12345-0@lo:400: 00000100:00100000:1.0:1787359957.754241:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595969280:12345-0@lo:400: Request processed in 50us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.754249:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359957.754253:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595969152:0@lo:400: 00000100:00100000:1.0:1787359957.754274:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969792 00000100:00100000:1.0:1787359957.754278:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969792 00000100:00100000:2.0:1787359957.754282:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754305:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969920 00000100:00100000:1.0:1787359957.754309:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969920 00000100:00100000:2.0:1787359957.754312:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595969664:0@lo:400: 00000100:00100000:1.0:1787359957.754328:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787359957.754334:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754334:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595969792:12345-0@lo:400: 00000100:00100000:2.0:1787359957.754350:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787359957.754355:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595969024:0@lo:400: 00000100:00100000:1.0:1787359957.754360:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595969792:12345-0@lo:400: Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.754366:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359957.754377:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359957.754379:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754382:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595969920:12345-0@lo:400: 00000100:00100000:2.0:1787359957.754398:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595969536:0@lo:400: 00000100:00100000:1.0:1787359957.754404:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595969920:12345-0@lo:400: Request processed in 23us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.754416:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.754418:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359957.754432:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969152 00000100:00100000:1.0:1787359957.754433:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969408 00000100:00100000:2.0:1787359957.754436:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969152 00000100:00100000:1.0:1787359957.754436:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969408 00000100:00100000:2.0:1787359957.754450:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969664 00000100:00100000:2.0:1787359957.754453:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969664 00000100:00100000:1.0:1787359957.754458:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359957.754463:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595969408:12345-0@lo:400: 00000100:00100000:2.0:1787359957.754465:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969536 00000100:00100000:2.0:1787359957.754467:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969536 00000100:00100000:2.0:1787359957.754479:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787359957.754484:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595969152:12345-0@lo:400: 00000100:00100000:1.0:1787359957.754494:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595969408:12345-0@lo:400: Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.754499:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787359957.754514:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595969152:12345-0@lo:400: Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.754519:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359957.754519:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787359957.754526:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787359957.754528:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787359957.754534:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595969664:12345-0@lo:400: 00000100:00100000:2.0:1787359957.754561:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595969664:12345-0@lo:400: Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.754566:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787359957.754681:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359957.754685:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787359957.754687:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359957.754702:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595969024 00000100:00100000:2.0:1787359957.754704:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359957.754705:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595969024 00000100:00100000:2.0:1787359957.754709:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595969536:12345-0@lo:400: 00000100:00100000:1.0:1787359957.754734:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787359957.754737:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595969536:12345-0@lo:400: Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.754740:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3659:x1874182595969024:12345-0@lo:400: 00000100:00100000:2.0:1787359957.754743:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359957.754768:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3659:x1874182595969024:12345-0@lo:400: Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.754773:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787359957.754779:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595969024:0@lo:400: 00010000:00080000:2.0:1787359957.754792:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2d80 x1874182595969536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359957.754803:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595969536:0@lo:400: 00010000:00080000:2.0:1787359957.754812:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a1180 x1874182595969152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359957.754819:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595969152:0@lo:400: 00010000:00080000:2.0:1787359957.754827:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a0fc31880 x1874182595969664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359957.754833:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595969664:0@lo:400: 00000100:00100000:1.0:1787359957.754866:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595969408:0@lo:400: 00010000:00080000:1.0:1787359957.754876:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3fedfb80 x1874182595969920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359957.754882:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595969920:0@lo:400: 00010000:00080000:1.0:1787359957.754890:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595969280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359957.754908:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595969280:0@lo:400: 00010000:00080000:1.0:1787359957.754918:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3fede300 x1874182595969792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359957.754926:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595969792:0@lo:400: 00010000:00010000:0.0:1787359958.138493:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359958.273196:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787359958.273221:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595970048:0@lo:13: 00000100:00100000:1.0:1787359958.273355:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359958.273415:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970048 00000100:00100000:1.0:1787359958.273421:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970048 00000100:00100000:1.0:1787359958.273462:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787359958.273470:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595970048:12345-0@lo:13: 00002000:00000024:1.0:1787359958.273497:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359958.273539:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595970048:12345-0@lo:13: Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359958.273545:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787359958.273597:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3fede300 x1874182595970048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359958.273614:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595970048:0@lo:13: 00000100:00100000:0.0:1787359958.275389:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359958.275411:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595970176:0@lo:13: 00000100:00100000:0.0:1787359958.275470:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359958.275768:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970176 00000100:00100000:1.0:1787359958.275775:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970176 00000100:00100000:1.0:1787359958.275827:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359958.275836:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595970176:12345-0@lo:13: 00002000:00000024:1.0:1787359958.275856:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359958.275902:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595970176:12345-0@lo:13: Request processed in 67us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359958.275921:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787359958.275961:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902916a00 x1874182595970176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359958.275977:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595970176:0@lo:13: 00010000:00010000:1.0:1787359959.162784:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787359959.245050:0:9526:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787359959.245054:0:9526:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787359959.245056:0:9526:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787359959.245163:0:9526:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998902639800 00000020:01000004:0.0:1787359959.245179:0:9526:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787359959.245192:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787359959.245205:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff998a3c900000) 00000020:00000080:0.0:1787359959.245223:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787359959.296986:0:9526:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787359959.297043:0:9526:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787359959.351555:0:9526:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787359959.351774:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787359959.351786:0:9526:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787359959.351797:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee71fe18 00000020:01000004:0.0:1787359959.351803:0:9526:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787359959.351822:0:9526:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787359959.351825:0:9526:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787359959.351831:0:9526:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787359959.351856:0:9526:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787359959.351859:0:9526:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787359959.388390:0:9526:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787359959.388433:0:9526:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787359959.388438:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787359959.388440:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359959.388442:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359959.388443:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359959.388444:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359959.388446:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359959.388447:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359959.388449:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359959.388450:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359959.388452:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359959.388453:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787359959.388462:0:9526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787359959.388464:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787359959.388465:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359959.388466:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359959.388467:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359959.388468:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359959.388469:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359959.388470:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359959.388471:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359959.388472:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359959.388472:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359959.388473:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787359959.388498:0:9526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787359959.388517:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595970304:0@lo:253: 00000100:00100000:2.0:1787359959.388593:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.388653:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a13dec000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359959.388663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970304 00000100:00100000:0.0:1787359959.388670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970304 00000100:00100000:0.0:1787359959.388725:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787359959.388822:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:9526:x1874182595970304:12345-0@lo:253: 20000000:01000000:3.0:1787359959.388856:0:6525:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787359959.388861:0:6525:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787359959.388866:0:6525:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787359959.388869:0:6525:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787359959.389074:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359959.389193:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787359959.389207:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787359959.389258:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787359959.389267:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787359959.389283:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787359959.389300:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1787359959.389384:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1787359959.389398:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:3.0:1787359959.389400:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:3.0:1787359959.389414:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1787359959.389420:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787359959.389434:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1787359959.389439:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:3.0:1787359959.389452:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1787359959.389458:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787359959.389471:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1787359959.389488:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1787359959.389559:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1787359959.389570:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:3.0:1787359959.389572:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:3.0:1787359959.389587:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1787359959.389601:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787359959.389617:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1787359959.389622:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:3.0:1787359959.389635:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1787359959.389650:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787359959.389666:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1787359959.389682:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1787359959.390063:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1787359959.390076:0:6525:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.111@tcp 20000000:01000000:3.0:1787359959.390077:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.111@tcp (null) (null) (null) 00000040:00080000:3.0:1787359959.390108:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1787359959.390116:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787359959.390131:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1787359959.390136:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.111@tcp (null) (null) 00000040:00080000:3.0:1787359959.390150:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1787359959.390156:0:6525:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787359959.390169:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1787359959.390185:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1787359959.390198:0:6525:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787359959.390201:0:6525:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787359959.390205:0:6525:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787359959.390274:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787359959.390277:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787359959.391404:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787359959.391447:0:9532:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787359959.391460:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787359959.392929:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787359959.392959:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787359959.392976:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1787359959.392987:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787359959.392989:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787359959.393912:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787359959.394099:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787359959.394124:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787359959.394140:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1787359959.394158:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787359959.394160:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787359959.397487:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787359959.397532:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787359959.397551:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787359959.398088:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787359959.398113:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787359959.398130:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787359959.398154:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787359959.398157:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787359959.403368:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1787359959.403420:0:9535:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1787359959.403438:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787359959.403739:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787359959.403765:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787359959.403781:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787359959.403793:0:6525:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787359959.403796:0:6525:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787359959.405030:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1787359959.405065:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1787359959.405080:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1787359959.405288:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1787359959.405314:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1787359959.405329:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1787359959.405345:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787359959.405368:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405385:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405393:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405400:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405407:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405414:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405420:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405426:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405434:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405476:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405491:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 21 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.405516:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970432:0@lo:104: 00000100:00100000:2.0:1787359959.405580:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.405629:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405638:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 21 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.405658:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970560:0@lo:104: 00000100:00100000:2.0:1787359959.405792:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.405827:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405837:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.405845:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970688:0@lo:104: 00000100:00100000:2.0:1787359959.405865:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.405881:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405888:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.405895:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970816:0@lo:104: 00000100:00100000:2.0:1787359959.405914:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.405929:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.405949:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.405957:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970944:0@lo:104: 00000100:00100000:2.0:1787359959.405980:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.405998:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.406006:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 21 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.406014:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595971072:0@lo:104: 00000100:00100000:0.0:1787359959.406024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970432 00000100:00100000:0.0:1787359959.406031:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970432 00000100:00100000:2.0:1787359959.406034:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359959.406048:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.406056:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 21 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.406062:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595971200:0@lo:104: 00000100:00100000:0.0:1787359959.406070:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787359959.406078:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359959.406085:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.406093:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970560 00000100:00100000:0.0:1787359959.406097:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970560 00000100:00100000:0.0:1787359959.406117:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970688 00000100:00100000:0.0:1787359959.406121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970688 00000100:00100000:0.0:1787359959.406129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970816 00000100:00100000:0.0:1787359959.406132:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970816 00000100:00100000:0.0:1787359959.406139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595970944 00000100:00100000:0.0:1787359959.406141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595970944 00000100:00100000:0.0:1787359959.406148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971072 00000100:00100000:0.0:1787359959.406150:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971072 00000100:00100000:0.0:1787359959.406158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971200 00000100:00100000:0.0:1787359959.406161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971200 00000100:00100000:0.0:1787359959.406172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787359959.406179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6525:x1874182595970432:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406190:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406265:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359959.406271:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:6525:x1874182595970432:12345-0@lo:104: Request processed in 92us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787359959.406315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359959.406322:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:6525:x1874182595970560:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406329:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406360:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787359959.406365:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:6525:x1874182595970560:12345-0@lo:104: Request processed in 44us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406370:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359959.406381:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787359959.406387:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6525:x1874182595970688:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406399:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406432:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787359959.406593:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:6525:x1874182595970688:12345-0@lo:104: Request processed in 206us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406600:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787359959.406614:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787359959.406621:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6525:x1874182595970816:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406628:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406669:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787359959.406674:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:6525:x1874182595970816:12345-0@lo:104: Request processed in 55us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406680:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787359959.406692:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787359959.406698:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6525:x1874182595970944:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406705:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406728:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787359959.406732:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:6525:x1874182595970944:12345-0@lo:104: Request processed in 36us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787359959.406747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359959.406752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ffd8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6525:x1874182595971072:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406765:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406789:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787359959.406793:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ffd8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6525:x1874182595971072:12345-0@lo:104: Request processed in 41us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406798:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359959.406822:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787359959.406829:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6525:x1874182595971200:12345-0@lo:104: 00010000:00010000:0.0:1787359959.406835:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406859:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787359959.406864:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6525:x1874182595971200:12345-0@lo:104: Request processed in 36us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.406869:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787359959.406886:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787359959.406891:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406898:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.406902:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.406910:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.406987:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970432:0@lo:104: 00000100:00100000:2.0:1787359959.406996:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970560:0@lo:104: 00000100:00100000:2.0:1787359959.407002:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970688:0@lo:104: 00000100:00100000:2.0:1787359959.407008:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970816:0@lo:104: 00000100:00100000:2.0:1787359959.407014:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595970944:0@lo:104: 00000100:00100000:2.0:1787359959.407030:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595971072:0@lo:104: 10000000:00010000:0.0:1787359959.407034:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.407036:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6525:1874182595971200:0@lo:104: 10000000:01000000:0.0:1787359959.407046:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359959.407061:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407079:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407085:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359959.407109:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407117:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697c00/0x359a4e2aee71fe03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe0a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407128:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787359959.407131:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.407135:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971328:0@lo:103: 00010000:00010000:0.0:1787359959.407136:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407139:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407145:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359959.407151:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407156:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787359959.407162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359959.407179:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407184:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787359959.407270:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971328 00000100:00100000:2.0:1787359959.407276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971328 00010000:00010000:2.0:1787359959.407295:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 22 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.407317:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359959.407325:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3660:x1874182595971328:12345-0@lo:103: 00010000:00010000:2.0:1787359959.407335:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359959.407340:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 22 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.407350:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 22 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.407363:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fe0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fe03 expref: 22 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.407375:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359959.407400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182595971328:12345-0@lo:103: Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.407407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359959.407471:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971328:0@lo:103: 00000100:00100000:3.0:1787359959.407483:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359959.407489:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971456:0@lo:103: 00000100:00100000:3.0:1787359959.407525:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359959.407530:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407538:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71fdd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fde0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407547:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787359959.407550:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407556:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407559:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407566:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359959.407572:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407577:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359959.407599:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407605:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359959.407620:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee71fdbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdc4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407635:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787359959.407655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407661:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407664:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407671:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359959.407677:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407682:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359959.407697:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407702:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359959.407707:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407712:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee71fd93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd9a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407721:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787359959.407724:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407729:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407731:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407746:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359959.407752:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407757:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359959.407768:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407773:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359959.407780:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fd77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd7e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407794:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359959.407797:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407802:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407805:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407812:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359959.407817:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407828:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359959.407842:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407847:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359959.407852:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407859:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fd38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd3f expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.407866:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971840:0@lo:103: 00010000:00010000:0.0:1787359959.407867:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359959.407870:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407875:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359959.407878:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.407884:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.407889:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1787359959.407890:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359959.407895:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787359959.407908:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787359959.407910:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.407913:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971968:0@lo:103: 00010000:00010000:0.0:1787359959.407915:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787359959.407933:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.407956:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971456 00000100:00100000:3.0:1787359959.407960:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971456 00010000:00010000:3.0:1787359959.407977:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 21 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.407996:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971840 00000100:00100000:3.0:1787359959.407999:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971840 00010000:00010000:3.0:1787359959.408009:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 22 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.408018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971968 00000100:00100000:3.0:1787359959.408027:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971968 00010000:00010000:3.0:1787359959.408040:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 23 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359959.408051:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359959.408058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3660:x1874182595971456:12345-0@lo:103: 00010000:00010000:3.0:1787359959.408065:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359959.408070:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 23 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408079:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 23 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408089:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696000/0x359a4e2aee71fde0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fdd9 expref: 23 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408099:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359959.408129:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3660:x1874182595971456:12345-0@lo:103: Request processed in 71us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.408134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359959.408147:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359959.408153:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182595971840:12345-0@lo:103: 00010000:00010000:3.0:1787359959.408160:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359959.408164:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408172:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408181:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee71fd7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd77 expref: 21 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408195:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359959.408217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3660:x1874182595971840:12345-0@lo:103: Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.408223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359959.408256:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359959.408262:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3660:x1874182595971968:12345-0@lo:103: 00010000:00010000:3.0:1787359959.408271:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359959.408275:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408282:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408292:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689200/0x359a4e2aee71fd3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd38 expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.408300:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359959.408321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28ec1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3660:x1874182595971968:12345-0@lo:103: Request processed in 59us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.408326:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359959.408375:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971968:0@lo:103: 00000100:00100000:3.0:1787359959.408383:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971840:0@lo:103: 00000100:00100000:3.0:1787359959.408390:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595971456:0@lo:103: 00010000:00010000:0.0:1787359959.408579:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.408586:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01516600/0x359a4e2aee71fd0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd15 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.408599:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359959.408601:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359959.408603:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359959.408610:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359959.408867:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359959.408884:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595971584:0@lo:103: 00000100:00100000:1.0:1787359959.408919:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.408948:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595972096:0@lo:103: 00000100:00100000:1.0:1787359959.408968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.408996:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359959.409001:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595971712:0@lo:103: 00000100:00100000:1.0:1787359959.409021:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.409166:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971584 00000100:00100000:2.0:1787359959.409172:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971584 00010000:00010000:2.0:1787359959.409193:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 18 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.409219:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972096 00000100:00100000:2.0:1787359959.409275:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972096 00010000:00010000:2.0:1787359959.409288:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 19 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.409300:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595971712 00000100:00100000:2.0:1787359959.409303:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595971712 00010000:00010000:2.0:1787359959.409313:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 20 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.409324:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787359959.409331:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3658:x1874182595971584:12345-0@lo:103: 00010000:00010000:2.0:1787359959.409340:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359959.409344:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 20 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.409354:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 20 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.409367:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696600/0x359a4e2aee71fdc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fdbd expref: 20 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.409376:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359959.409403:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787359959.409410:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3658:x1874182595971584:12345-0@lo:103: Request processed in 80us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.409410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3658:x1874182595972096:12345-0@lo:103: 00000100:00100000:2.0:1787359959.409416:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787359959.409418:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359959.409423:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 19 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.409431:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 18 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.409436:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787359959.409443:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3658:x1874182595971712:12345-0@lo:103: 00010000:00010000:2.0:1787359959.409449:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359959.409453:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 18 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.409455:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689400/0x359a4e2aee71fd15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd0e expref: 18 pid: 6524 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.409461:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 18 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359959.409526:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595971584:0@lo:103: 00010000:00010000:0.0:1787359959.412273:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359959.412636:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:3658:x1874182595972096:12345-0@lo:103: Request processed in 3222us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.412659:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787359959.412726:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595972096:0@lo:103: 00010000:00010000:2.0:1787359959.413391:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688600/0x359a4e2aee71fd9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd93 expref: 16 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413411:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413419:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413437:0:7474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413445:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413452:0:7474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413460:0:7474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413466:0:7474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787359959.413470:0:7474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.413494:0:7474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.419843:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.419890:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787359959.419900:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787359959.421037:0:7474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.421053:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697400/0x359a4e2aee71fe1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.421079:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359959.421214:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3658:x1874182595971712:12345-0@lo:103: Request processed in 11768us (12188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.421250:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787359959.422449:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595971712:0@lo:103: 00000100:00100000:3.0:1787359959.427888:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:9526:x1874182595970304:12345-0@lo:253: Request processed in 39145us (39287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.427902:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787359959.428066:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595970304:0@lo:253: 10000000:01000000:2.0:1787359959.428083:0:9526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787359959.428086:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787359959.428087:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359959.428089:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359959.428090:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787359959.428092:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359959.428093:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359959.428095:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359959.428097:0:9526:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787359959.428098:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359959.428099:0:9526:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787359959.428121:0:9526:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998902639800 from lustre-OST0001 10000000:01000000:2.0:1787359959.428151:0:9526:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787359959.428154:0:9526:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787359959.428162:0:9526:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a3bac8000 local copy 10000000:01000000:2.0:1787359959.428166:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787359959.428201:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.428220:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.428497:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.428517:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972224:0@lo:101: 00000100:00100000:2.0:1787359959.428556:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.428863:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.429079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972224 00000100:00100000:1.0:1787359959.429087:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972224 00000100:00100000:1.0:1787359959.429140:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787359959.429149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+14:9526:x1874182595972224:12345-0@lo:101: 00010000:00010000:1.0:1787359959.429162:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359959.429174:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a00030800/0x359a4e2aee71fe2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.429208:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a00030800/0x359a4e2aee71fe2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe26 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.429218:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a00030800/0x359a4e2aee71fe2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe26 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.429458:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00030800, rc 0) 00000100:00100000:1.0:1787359959.429501:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972224:12345-0@lo:101: Request processed in 353us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.429507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787359959.429602:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972224:0@lo:101: 00010000:00010000:0.0:1787359959.429616:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.429635:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.429748:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972352:0@lo:501: 00000100:00100000:0.0:1787359959.429777:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.429808:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.430613:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972352 00000100:00100000:1.0:1787359959.430621:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972352 00000100:00100000:1.0:1787359959.430679:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787359959.430689:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972352:12345-0@lo:501: 00000100:00100000:1.0:1787359959.430780:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972352:12345-0@lo:501: Request processed in 93us (1001us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359959.430788:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787359959.430879:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972352:0@lo:501: 10000000:01000000:0.0:1787359959.430895:0:9526:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787359959.430916:0:9526:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787359959.430935:0:9526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.430944:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.430951:0:9526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.430973:0:9526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787359959.430998:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998902639800 10000000:01000000:0.0:1787359959.431003:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787359959.431008:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787359959.431010:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359959.431014:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787359959.431017:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787359959.431039:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.431058:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.431067:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.431082:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972480:0@lo:101: 00000100:00100000:0.0:1787359959.431113:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.431136:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.432048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972480 00000100:00100000:1.0:1787359959.432058:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972480 00000100:00100000:1.0:1787359959.432113:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787359959.432123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972480:12345-0@lo:101: 00010000:00010000:1.0:1787359959.432137:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359959.432154:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe34 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432176:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432203:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432212:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00030600, rc 0) 00000100:00100000:1.0:1787359959.432580:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595972480:12345-0@lo:101: Request processed in 456us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.432588:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:1.0:1787359959.432626:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359959.432632:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432652:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787359959.432657:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432667:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359959.432674:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359959.432680:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359959.432704:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432710:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359959.432740:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432760:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee71fe26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x359a4e2aee71fe2d expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432774:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359959.432776:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359959.432778:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359959.432807:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972480:0@lo:101: 00010000:00010000:1.0:1787359959.432825:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.432833:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.433018:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595972608:0@lo:103: 00000100:00100000:0.0:1787359959.433054:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.433219:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972736:0@lo:501: 00000100:00100000:1.0:1787359959.433549:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.433579:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.433656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972736 00000100:00100000:2.0:1787359959.433663:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972736 00000100:00100000:2.0:1787359959.433706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787359959.433715:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595972736:12345-0@lo:501: 00000100:00100000:2.0:1787359959.433823:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595972736:12345-0@lo:501: Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.433830:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787359959.434017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972608 00000100:00100000:3.0:1787359959.434022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972608 00000100:00100000:3.0:1787359959.434057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359959.434064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595972608:12345-0@lo:103: 00010000:00010000:3.0:1787359959.434072:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359959.434087:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a00030800/0x359a4e2aee71fe2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fe26 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359959.434101:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359959.434131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3659:x1874182595972608:12345-0@lo:103: Request processed in 68us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.434137:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359959.434164:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595972608:0@lo:103: 00000100:00100000:1.0:1787359959.435130:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972736:0@lo:501: 00000100:00100000:1.0:1787359959.435174:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972864:0@lo:503: 00000100:00100000:1.0:1787359959.436028:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.436116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972864 00000100:00100000:2.0:1787359959.436124:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972864 00000100:00100000:2.0:1787359959.436164:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787359959.436173:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972864:12345-0@lo:503: 00000100:00100000:2.0:1787359959.436666:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972864:12345-0@lo:503: Request processed in 492us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.436675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787359959.436725:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.436742:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972864:0@lo:503: 00000040:00080000:2.0:1787359959.438013:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787359959.438128:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972992:0@lo:502: 00000100:00100000:2.0:1787359959.438184:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.438360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595972992 00000100:00100000:1.0:1787359959.438368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595972992 00000100:00100000:1.0:1787359959.438404:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787359959.438413:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972992:12345-0@lo:502: 00000100:00100000:0.0:1787359959.441534:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595972992:12345-0@lo:502: Request processed in 3112us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.441547:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787359959.441695:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359959.441783:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595972992:0@lo:502: 00000040:00080000:0.0:1787359959.442076:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787359959.442104:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787359959.442116:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787359959.442127:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787359959.442138:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787359959.442148:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787359959.442178:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973120:0@lo:502: 00000100:00100000:0.0:1787359959.442585:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.442623:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.442699:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973120 00000100:00100000:2.0:1787359959.442707:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973120 00000100:00100000:2.0:1787359959.442762:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787359959.442771:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595973120:12345-0@lo:502: 00000100:00100000:2.0:1787359959.442877:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595973120:12345-0@lo:502: Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.442884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787359959.443106:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973120:0@lo:502: 00000040:00080000:0.0:1787359959.443162:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787359959.443179:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787359959.444608:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787359959.444618:0:9537:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787359959.444625:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359959.444627:0:9537:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787359959.444633:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359959.444674:0:9537:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9989034d19b8) 00000020:00000080:3.0:1787359959.444699:0:9537:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787359959.444706:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787359959.444780:0:9537:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998902639800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787359959.444788:0:9537:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787359959.444794:0:9537:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee71fe49 00010000:00010000:3.0:1787359959.454991:0:9537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787359959.455671:0:9537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787359959.458337:0:9537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787359959.458661:0:9537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787359959.463020:0:9537:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787359959.463202:0:9537:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787359959.471911:0:9537:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787359959.474573:0:9537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787359959.474588:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359959.474594:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359959.474596:0:9537:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787359959.474600:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359959.474605:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359959.474607:0:9537:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787359959.474611:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787359959.474613:0:9537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787359959.474654:0:9537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359959.474658:0:9537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359959.474659:0:9537:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787359959.474662:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787359959.474822:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787359959.474854:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787359959.474876:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.474896:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359959.474905:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998902639800 from 1 10000000:01000000:1.0:1787359959.474908:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359959.474952:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.474961:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.474972:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359959.474993:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973248:0@lo:101: 00000100:00100000:1.0:1787359959.475053:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.475088:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359959.475214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973248 00000100:00100000:0.0:1787359959.475222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973248 00000100:00100000:0.0:1787359959.475283:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787359959.475302:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:9526:x1874182595973248:12345-0@lo:101: 00010000:00010000:0.0:1787359959.475467:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359959.475480:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.475501:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.475510:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.475519:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681800, rc 0) 00000100:00100000:0.0:1787359959.475558:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973248:12345-0@lo:101: Request processed in 258us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.475564:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787359959.475663:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973248:0@lo:101: 00010000:00010000:1.0:1787359959.475677:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.475686:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359959.475771:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973376:0@lo:501: 00000100:00100000:1.0:1787359959.475797:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.475822:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeb30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.475844:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973376 00000100:00100000:1.0:1787359959.475849:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973376 00000100:00100000:1.0:1787359959.475875:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787359959.475882:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973376:12345-0@lo:501: 00000100:00100000:1.0:1787359959.476049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973376:12345-0@lo:501: Request processed in 166us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.476057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787359959.476089:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973376:0@lo:501: 00000100:00100000:1.0:1787359959.476116:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973504:0@lo:503: 00000100:00100000:1.0:1787359959.476156:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.476170:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfe600 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.476183:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973504 00000100:00100000:1.0:1787359959.476187:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973504 00000100:00100000:1.0:1787359959.476204:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787359959.476209:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973504:12345-0@lo:503: 00000100:00100000:1.0:1787359959.476669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973504:12345-0@lo:503: Request processed in 458us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.476676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787359959.478686:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973504:0@lo:503: 00000040:00080000:0.0:1787359959.479176:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359959.479459:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973632:0@lo:502: 00000100:00100000:0.0:1787359959.479532:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.479634:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.480549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973632 00000100:00100000:1.0:1787359959.480558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973632 00000100:00100000:0.0:1787359959.481932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787359959.481945:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973632:12345-0@lo:502: 00000100:00100000:0.0:1787359959.482104:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973632:12345-0@lo:502: Request processed in 161us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.482120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787359959.482300:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973632:0@lo:502: 00000040:00080000:2.0:1787359959.482719:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787359959.482750:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787359959.482783:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973760:0@lo:502: 00000100:00100000:2.0:1787359959.482832:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.482877:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.482958:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973760 00000100:00100000:1.0:1787359959.482965:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973760 00000100:00100000:1.0:1787359959.483008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787359959.483016:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973760:12345-0@lo:502: 00000100:00100000:1.0:1787359959.483105:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973760:12345-0@lo:502: Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.483112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787359959.483276:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973760:0@lo:502: 00000040:00080000:2.0:1787359959.483494:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787359959.483503:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787359959.484070:0:9541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359959.484079:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359959.484081:0:9541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787359959.484088:0:9541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998902639800 00000020:00000080:1.0:1787359959.484090:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787359959.484102:0:9541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359959.484105:0:9541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359959.484107:0:9541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787359959.484109:0:9541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787359959.484269:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787359959.484513:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359959.484538:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.484549:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359959.484597:0:9526:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787359959.484605:0:9526:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998902639800 10000000:01000000:2.0:1787359959.484608:0:9526:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998902639800 10000000:01000000:2.0:1787359959.484611:0:9526:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787359959.484616:0:9526:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998902639800 from 1 10000000:01000000:2.0:1787359959.484619:0:9526:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359959.484656:0:9526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.484664:0:9526:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.484673:0:9526:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.484691:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973888:0@lo:101: 00000100:00100000:2.0:1787359959.484741:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.484774:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.484905:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595973888 00000100:00100000:1.0:1787359959.484913:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595973888 00000100:00100000:1.0:1787359959.485027:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787359959.485038:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9526:x1874182595973888:12345-0@lo:101: 00010000:00010000:1.0:1787359959.485049:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359959.485062:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe5e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.485083:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.485093:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359959.485102:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00031a00, rc 0) 00000100:00100000:1.0:1787359959.485150:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595973888:12345-0@lo:101: Request processed in 114us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.485156:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787359959.485265:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595973888:0@lo:101: 00010000:00010000:0.0:1787359959.485279:0:9526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.485302:0:9526:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.485538:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974016:0@lo:501: 00000100:00100000:0.0:1787359959.485566:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.485586:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.485660:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974016 00000100:00100000:1.0:1787359959.485665:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974016 00000100:00100000:1.0:1787359959.485701:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787359959.485708:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974016:12345-0@lo:501: 00000100:00100000:1.0:1787359959.485813:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974016:12345-0@lo:501: Request processed in 105us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.485821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787359959.485855:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974016:0@lo:501: 00000100:00100000:1.0:1787359959.485881:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974144:0@lo:503: 00000100:00100000:1.0:1787359959.486039:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.486148:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359959.490035:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974144 00000100:00100000:0.0:1787359959.490050:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974144 00000100:00100000:0.0:1787359959.490541:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787359959.490552:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974144:12345-0@lo:503: 00000100:00100000:0.0:1787359959.490726:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974144:12345-0@lo:503: Request processed in 175us (4685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.490733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787359959.490956:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974144:0@lo:503: 00000040:00080000:0.0:1787359959.491200:0:9526:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359959.491478:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974272:0@lo:502: 00000100:00100000:0.0:1787359959.491527:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.491943:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.492110:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974272 00000100:00100000:2.0:1787359959.492117:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974272 00000100:00100000:2.0:1787359959.492163:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787359959.492172:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974272:12345-0@lo:502: 00000100:00100000:3.0:1787359959.492611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974272:12345-0@lo:502: Request processed in 437us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.492621:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787359959.492687:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974272:0@lo:502: 00000040:00080000:3.0:1787359959.492892:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787359959.492991:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787359959.493014:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787359959.493032:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787359959.493061:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787359959.493078:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787359959.493094:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787359959.493108:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787359959.493121:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787359959.493135:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787359959.493150:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787359959.493164:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787359959.493179:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787359959.493193:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787359959.493209:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787359959.493278:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787359959.493469:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787359959.493485:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787359959.493496:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787359959.493507:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787359959.493519:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787359959.493529:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787359959.493540:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787359959.493552:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787359959.493564:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787359959.493575:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787359959.493586:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787359959.493598:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787359959.493609:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787359959.493620:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787359959.493632:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787359959.493672:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787359959.493689:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787359959.493702:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787359959.493714:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787359959.493726:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787359959.493737:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1787359959.493757:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787359959.493769:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1787359959.493781:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1787359959.493792:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1787359959.493804:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1787359959.493816:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1787359959.493827:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1787359959.493839:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1787359959.493851:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1787359959.493887:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974400:0@lo:502: 00000100:00100000:3.0:1787359959.494122:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.494199:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359959.494388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974400 00000100:00100000:1.0:1787359959.494396:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974400 00000100:00100000:1.0:1787359959.494444:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787359959.494455:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974400:12345-0@lo:502: 00000100:00100000:1.0:1787359959.494567:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595974400:12345-0@lo:502: Request processed in 114us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359959.494575:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787359959.494692:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595974400:0@lo:502: 00000040:00080000:3.0:1787359959.494746:0:9526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1787359959.494756:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1787359959.495819:0:9542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787359959.495835:0:9542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99890273cd28) 00000020:00000080:2.0:1787359959.495859:0:9542:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1787359959.495945:0:9542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998902639800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787359959.495949:0:9542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998902639800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787359959.495952:0:9542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998902639800 3 00010000:00080000:2.0:1787359959.495979:0:9542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998902614000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787359959.501103:0:9542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1787359959.502283:0:9542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787359959.502357:0:9542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787359959.502381:0:9542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x359a4e2aee71fe73 00000100:00080000:2.0:1787359959.502392:0:9542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787359959.502398:0:9542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787359959.502432:0:9542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3c9a3100 x1874182595974528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787359959.502470:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182595974528:0@lo:38: 00000100:00100000:2.0:1787359959.502543:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.506074:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974528 00000100:00100000:2.0:1787359959.506089:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974528 00000100:00100000:2.0:1787359959.506137:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359959.506146:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182595974528:12345-0@lo:38: 00010000:00080000:2.0:1787359959.506175:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787359959.506213:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x359a4e2aee71fe7a 00000004:00100000:2.0:1787359959.506243:0:6532:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787359959.506279:0:6532:0:(import.c:65:import_set_state_nolock()) ffff99890384f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359959.507086:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874182595974528:12345-0@lo:38: Request processed in 936us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.507096:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787359959.507159:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3100 x1874182595974528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359959.507171:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787359959.507180:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787359959.507188:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787359959.507192:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787359959.507195:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787359959.507200:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182595974528:0@lo:38: 00000100:00080000:2.0:1787359959.507251:0:9542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787359959.507576:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595974784:0@lo:400: 00000100:00100000:2.0:1787359959.507618:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.507656:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182595975296:0@lo:400: 00000100:00100000:2.0:1787359959.507678:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.507698:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787359959.507702:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182595974656:0@lo:400: 00000100:00100000:2.0:1787359959.507720:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.507745:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182595975168:0@lo:400: 00000100:00100000:2.0:1787359959.507762:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.507785:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974784 00000100:00100000:2.0:1787359959.507790:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974784 00000100:00100000:2.0:1787359959.507824:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787359959.507832:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595974784:12345-0@lo:400: 00000100:00100000:2.0:1787359959.507870:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595974784:12345-0@lo:400: Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.507876:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787359959.507894:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975296 00000100:00100000:2.0:1787359959.507897:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975296 00000100:00100000:0.0:1787359959.508042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974656 00000100:00100000:0.0:1787359959.508046:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974656 00000100:00100000:0.0:1787359959.508065:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975168 00000100:00100000:0.0:1787359959.508073:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975168 00000100:00100000:0.0:1787359959.508090:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787359959.508096:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182595975296:12345-0@lo:400: 00000100:00100000:0.0:1787359959.508129:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182595975296:12345-0@lo:400: Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.508135:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787359959.508148:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359959.508154:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182595974656:12345-0@lo:400: 00000100:00100000:0.0:1787359959.508176:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182595974656:12345-0@lo:400: Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.508181:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359959.508193:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787359959.508198:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182595975168:12345-0@lo:400: 00000100:00100000:0.0:1787359959.508219:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182595975168:12345-0@lo:400: Request processed in 21us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.508239:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787359959.508486:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595975040:0@lo:400: 00000100:00100000:3.0:1787359959.508519:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.508729:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595975552:0@lo:400: 00000100:00100000:3.0:1787359959.508753:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.508779:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787359959.508785:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182595974912:0@lo:400: 00000100:00100000:3.0:1787359959.508808:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.508825:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595975424:0@lo:400: 00000100:00100000:3.0:1787359959.508844:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359959.508870:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975552 00000100:00100000:3.0:1787359959.508874:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975552 00000100:00100000:3.0:1787359959.508908:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975424 00000100:00100000:3.0:1787359959.508911:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975424 00000100:00100000:3.0:1787359959.508970:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359959.508978:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595975552:12345-0@lo:400: 00000100:00100000:3.0:1787359959.509018:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595975552:12345-0@lo:400: Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.509038:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359959.509053:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359959.509059:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595975424:12345-0@lo:400: 00000100:00100000:3.0:1787359959.509087:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595975424:12345-0@lo:400: Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.509093:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787359959.509129:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890388c700 x1874182595975424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359959.509141:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595975424:0@lo:400: 00010000:00080000:3.0:1787359959.509152:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890388d180 x1874182595975552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359959.509159:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595975552:0@lo:400: 00000100:00100000:3.0:1787359959.509180:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595974912 00000100:00100000:3.0:1787359959.509183:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595974912 00000100:00100000:3.0:1787359959.509206:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787359959.509213:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182595974912:12345-0@lo:400: 00000100:00100000:3.0:1787359959.509678:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182595974912:12345-0@lo:400: Request processed in 463us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.509684:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359959.510061:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975040 00000100:00100000:0.0:1787359959.510068:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975040 00000100:00100000:0.0:1787359959.510110:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787359959.510119:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595975040:12345-0@lo:400: 00000100:00100000:0.0:1787359959.510158:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595975040:12345-0@lo:400: Request processed in 41us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.510164:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787359959.510450:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359959.510456:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359959.510459:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787359959.510490:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a3100 x1874182595974656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359959.510514:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182595974656:0@lo:400: 00010000:00080000:0.0:1787359959.510529:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890388dc00 x1874182595975168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359959.510537:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182595975168:0@lo:400: 00000100:00100000:0.0:1787359959.510549:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595974784:0@lo:400: 00010000:00080000:0.0:1787359959.510560:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890388c000 x1874182595975296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359959.510568:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182595975296:0@lo:400: 00000020:01000004:1.0:1787359959.510864:0:9542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787359959.510878:0:9542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff998a3505cd28) 00000020:00000080:1.0:1787359959.510899:0:9542:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1787359959.510999:0:9542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998902639800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787359959.511003:0:9542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998902639800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787359959.511006:0:9542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998902639800 3 00010000:00080000:1.0:1787359959.511033:0:9542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998903736000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.111@tcp at head 00000100:00100000:0.0:1787359959.513091:0:9544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9544:1874182595975680:0@lo:901: 00000100:00100000:0.0:1787359959.513154:0:9544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.513202:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975680 00000100:00100000:0.0:1787359959.513209:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975680 00000100:00100000:0.0:1787359959.513500:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359959.513510:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9544:x1874182595975680:12345-0@lo:901: 00010000:00010000:1.0:1787359959.513784:0:9542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:0.0:1787359959.514016:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9544:x1874182595975680:12345-0@lo:901: Request processed in 507us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359959.514024:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787359959.514044:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359959.514057:0:9544:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee9b180 going to sleep for 11 seconds 00010000:00080000:0.0:1787359959.514078:0:9544:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998902914000 x1874182595975680/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787359975 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359959.514090:0:9544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9544:1874182595975680:0@lo:901: 00010000:00080000:3.0:1787359959.517286:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3c9a2680 x1874182595974912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359959.517305:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182595974912:0@lo:400: 00000100:00100000:3.0:1787359959.517332:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595975040:0@lo:400: 00000020:00000080:1.0:1787359959.518726:0:9542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787359959.518775:0:9542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787359959.518789:0:9542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x359a4e2aee71fe88 00000100:00080000:1.0:1787359959.518798:0:9542:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359959.518803:0:9542:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff998903736000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787359959.518845:0:9542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3feddc00 x1874182595975808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787359959.518867:0:9542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1787359959.523783:0:9542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1787359959.524407:0:9526:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1787359959.524439:0:9526:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359959.524462:0:9526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.524474:0:9526:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787359959.524527:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787359959.524529:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787359959.524531:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359959.524532:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359959.524533:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359959.524534:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359959.524536:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787359959.524537:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359959.524538:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359959.524540:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359959.524542:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359959.524545:0:9526:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787359959.524547:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359959.524549:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787359959.524550:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359959.524551:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359959.524552:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359959.524553:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359959.524554:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787359959.524555:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359959.524556:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359959.524557:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359959.524558:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359959.524583:0:9526:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787359959.524600:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595975936:0@lo:253: 00000100:00100000:0.0:1787359959.524676:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.524713:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.524891:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182595975808:0@lo:38: 00000100:00100000:2.0:1787359959.524933:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359959.525144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975936 00000100:00100000:1.0:1787359959.525151:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975936 00000100:00100000:1.0:1787359959.525258:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787359959.525270:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595975936:12345-0@lo:253: 20000000:01000000:1.0:1787359959.525301:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787359959.525316:0:6526:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787359959.525683:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595975808 00000100:00100000:3.0:1787359959.525688:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595975808 00000100:00100000:3.0:1787359959.525722:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359959.525727:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182595975808:12345-0@lo:38: 00010000:00080000:3.0:1787359959.525748:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:3.0:1787359959.525781:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x359a4e2aee71fe8f 00000004:00100000:3.0:1787359959.525796:0:6531:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787359959.525827:0:6531:0:(import.c:65:import_set_state_nolock()) ffff9989036e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359959.525884:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874182595975808:12345-0@lo:38: Request processed in 155us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359959.525892:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787359959.526449:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feddc00 x1874182595975808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359959.526460:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787359959.526467:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787359959.526474:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787359959.526479:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787359959.526481:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998903736000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787359959.526487:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182595975808:0@lo:38: 20000000:01000000:1.0:1787359959.535060:0:6526:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787359959.535086:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787359959.535758:0:6547:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787359959.535775:0:6547:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787359959.535795:0:6547:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.535812:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.535821:0:6547:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.535828:0:6547:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.535864:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.535879:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 17 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.535893:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595976064:0@lo:104: 00000100:00100000:0.0:1787359959.535953:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359959.536004:0:6547:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.536013:0:6547:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 17 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.536022:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595976192:0@lo:104: 00000100:00100000:0.0:1787359959.536042:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359959.536056:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359959.536118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976064 00000100:00100000:2.0:1787359959.536125:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976064 00000100:00100000:2.0:1787359959.536157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976192 00000100:00100000:2.0:1787359959.536160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976192 00000100:00100000:2.0:1787359959.536173:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359959.536181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595976064:12345-0@lo:104: 00010000:00010000:2.0:1787359959.536199:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536279:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787359959.536297:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:6547:x1874182595976064:12345-0@lo:104: Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.536306:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359959.536322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359959.536329:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595976192:12345-0@lo:104: 00010000:00010000:2.0:1787359959.536335:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536369:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787359959.536374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:6547:x1874182595976192:12345-0@lo:104: Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.536380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787359959.536397:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787359959.536402:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536409:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359959.536413:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536422:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359959.536428:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359959.536453:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359959.536486:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536492:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359959.536519:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71fdcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fdd2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536537:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359959.536540:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536546:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359959.536548:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536554:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359959.536560:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359959.536565:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359959.536578:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536583:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359959.536595:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536602:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01516000/0x359a4e2aee71fd85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd8c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536615:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359959.536617:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359959.536618:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359959.536625:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359959.536637:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595976448:0@lo:103: 00000100:00100000:2.0:1787359959.536679:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.536702:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359959.536708:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595976320:0@lo:103: 00000100:00100000:2.0:1787359959.536727:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.536752:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976448 00000100:00100000:2.0:1787359959.536757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976448 00010000:00010000:2.0:1787359959.536775:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 18 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.536795:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976320 00000100:00100000:2.0:1787359959.536798:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976320 00010000:00010000:2.0:1787359959.536809:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 19 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359959.536826:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359959.536833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3661:x1874182595976448:12345-0@lo:103: 00010000:00010000:2.0:1787359959.536842:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359959.536847:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536867:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 19 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536882:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359959.536913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3661:x1874182595976448:12345-0@lo:103: Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.536919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359959.536933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359959.536939:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3661:x1874182595976320:12345-0@lo:103: 00010000:00010000:2.0:1787359959.536946:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359959.536950:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 18 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536959:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 18 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536970:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.536978:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787359959.536990:0:6517:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004880570s 00010000:00010000:2.0:1787359959.536994:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537001:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537007:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537019:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537024:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787359959.537028:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537035:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537043:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359959.537053:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359959.537077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3661:x1874182595976320:12345-0@lo:103: Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.537083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359959.537117:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595976320:0@lo:103: 00000100:00100000:2.0:1787359959.537125:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595976448:0@lo:103: 00000100:00100000:2.0:1787359959.537738:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9526:x1874182595975936:12345-0@lo:253: Request processed in 12469us (13061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.537747:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787359959.538216:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9526:1874182595975936:0@lo:253: 10000000:01000000:1.0:1787359959.538253:0:9526:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787359959.538257:0:9526:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787359959.538259:0:9526:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787359959.538260:0:9526:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359959.538261:0:9526:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359959.538262:0:9526:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359959.538263:0:9526:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359959.538264:0:9526:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787359959.538266:0:9526:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359959.538267:0:9526:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359959.538268:0:9526:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359959.538270:0:9526:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787359959.538281:0:9526:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787359959.539982:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a00031800/0x359a4e2aee71fdd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fdcb expref: 16 pid: 6525 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.540013:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595976064:0@lo:104: 00010000:00010000:0.0:1787359959.540029:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688800/0x359a4e2aee71fd8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd85 expref: 15 pid: 6526 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359959.540038:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6547:1874182595976192:0@lo:104: 00010000:00010000:0.0:1787359959.540060:0:6547:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.540069:0:6547:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.540075:0:6547:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359959.540081:0:6547:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06680800/0x359a4e2aee71fe96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787359959.553600:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787359959.553765:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787359959.553920:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787359959.554073:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787359959.555406:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787359959.555752:0:9526:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787359959.556885:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787359959.595470:0:9526:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787359959.595480:0:9526:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787359959.595519:0:9526:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787359959.595566:0:9526:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787359959.595585:0:9526:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1787359959.595614:0:9526:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1787359959.596308:0:9526:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787359959.596483:0:9526:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787359960.185452:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359960.323305:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359960.323331:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595976576:0@lo:41: 00000100:00100000:3.0:1787359960.323395:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359960.323472:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976576 00000100:00100000:3.0:1787359960.323480:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976576 00000100:00100000:3.0:1787359960.323525:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359960.323545:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595976576:12345-0@lo:41: 00000004:00000024:3.0:1787359960.323579:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787359960.323625:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595976576:12345-0@lo:41: Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359960.323632:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359960.323687:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595976576:0@lo:41: 00000020:00000004:0.0:1787359960.677696:0:9598:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787359960.677933:0:9598:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787359961.215862:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359962.233371:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359962.362493:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359962.362526:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595976704:0@lo:41: 00000100:00100000:0.0:1787359962.362600:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359962.362719:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976704 00000100:00100000:1.0:1787359962.362727:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976704 00000100:00100000:1.0:1787359962.362783:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787359962.362794:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595976704:12345-0@lo:41: 00000004:00000024:1.0:1787359962.362825:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1787359962.362872:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595976704:12345-0@lo:41: Request processed in 79us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.362885:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787359962.363026:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595976704:0@lo:41: 00010000:00010000:0.0:1787359963.258157:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359963.385736:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359963.385762:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595976832:0@lo:13: 00000100:00100000:2.0:1787359963.385842:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359963.386082:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976832 00000100:00100000:1.0:1787359963.386090:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976832 00000100:00100000:1.0:1787359963.386155:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359963.386167:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595976832:12345-0@lo:13: 00002000:00000024:1.0:1787359963.386196:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359963.386261:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595976832:12345-0@lo:13: Request processed in 97us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359963.386336:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787359963.388407:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359963.388429:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595976960:0@lo:13: 00000100:00100000:3.0:1787359963.388503:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787359963.388663:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359963.388704:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3fedc700 x1874182595976832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359963.388723:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595976832:0@lo:13: 00000100:00100000:1.0:1787359963.389085:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595976960 00000100:00100000:1.0:1787359963.389092:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595976960 00000100:00100000:1.0:1787359963.389145:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787359963.389153:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595976960:12345-0@lo:13: 00002000:00000024:1.0:1787359963.389171:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359963.389219:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595976960:12345-0@lo:13: Request processed in 66us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359963.389253:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787359963.389359:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902915f80 x1874182595976960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359963.389373:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595976960:0@lo:13: 00000100:00080000:2.0:1787359963.389428:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787359964.282710:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359964.921527:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595977216:0@lo:400: 00000100:00100000:2.0:1787359964.921600:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921665:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595977728:0@lo:400: 00000100:00100000:2.0:1787359964.921687:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921709:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595978240:0@lo:400: 00000100:00100000:2.0:1787359964.921729:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921755:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787359964.921760:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595977088:0@lo:400: 00000100:00100000:2.0:1787359964.921788:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921810:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595977600:0@lo:400: 00000100:00100000:2.0:1787359964.921832:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921847:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595978112:0@lo:400: 00000100:00100000:2.0:1787359964.921867:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921891:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595977344:0@lo:400: 00000100:00100000:2.0:1787359964.921919:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921936:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595977856:0@lo:400: 00000100:00100000:2.0:1787359964.921954:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.921970:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595978368:0@lo:400: 00000100:00100000:2.0:1787359964.921988:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.922001:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787359964.922005:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595977472:0@lo:400: 00000100:00100000:2.0:1787359964.922024:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.922033:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595977984:0@lo:400: 00000100:00100000:2.0:1787359964.922076:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359964.922116:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977216 00000100:00100000:2.0:1787359964.922123:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977216 00000100:00100000:2.0:1787359964.922159:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977728 00000100:00100000:2.0:1787359964.922163:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977728 00000100:00100000:2.0:1787359964.922185:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978240 00000100:00100000:2.0:1787359964.922189:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978240 00000100:00100000:2.0:1787359964.922200:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977856 00000100:00100000:2.0:1787359964.922203:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977856 00000100:00100000:2.0:1787359964.922215:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978368 00000100:00100000:2.0:1787359964.922218:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978368 00000100:00100000:2.0:1787359964.922246:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977472 00000100:00100000:2.0:1787359964.922249:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977472 00000100:00100000:2.0:1787359964.922276:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359964.922285:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595977216:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922334:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595977216:12345-0@lo:400: Request processed in 50us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922341:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359964.922356:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787359964.922362:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595977728:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922395:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595977728:12345-0@lo:400: Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922402:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787359964.922424:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787359964.922429:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595978240:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922452:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595978240:12345-0@lo:400: Request processed in 23us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922457:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787359964.922468:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787359964.922473:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595977856:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922499:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595977856:12345-0@lo:400: Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922504:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787359964.922514:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787359964.922519:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595978368:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922542:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595978368:12345-0@lo:400: Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922547:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787359964.922559:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787359964.922564:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595977472:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922585:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595977472:12345-0@lo:400: Request processed in 22us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922591:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787359964.922624:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977088 00000100:00100000:2.0:1787359964.922628:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977088 00000100:00100000:2.0:1787359964.922651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787359964.922663:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3659:x1874182595977088:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922692:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3659:x1874182595977088:12345-0@lo:400: Request processed in 30us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922698:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787359964.922723:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977600 00000100:00100000:2.0:1787359964.922726:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977600 00000100:00100000:2.0:1787359964.922748:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977344 00000100:00100000:2.0:1787359964.922751:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977344 00000100:00100000:2.0:1787359964.922763:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787359964.922768:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595977600:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922796:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595977600:12345-0@lo:400: Request processed in 28us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922802:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787359964.922813:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787359964.922819:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595977344:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922844:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595977344:12345-0@lo:400: Request processed in 25us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922849:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787359964.922866:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978112 00000100:00100000:2.0:1787359964.922869:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978112 00000100:00100000:2.0:1787359964.922887:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595977984 00000100:00100000:2.0:1787359964.922890:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595977984 00000100:00100000:2.0:1787359964.922905:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787359964.922910:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595978112:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922937:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595978112:12345-0@lo:400: Request processed in 27us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922943:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787359964.922953:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787359964.922964:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595977984:12345-0@lo:400: 00000100:00100000:2.0:1787359964.922993:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595977984:12345-0@lo:400: Request processed in 30us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359964.922998:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787359964.923022:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359964.923025:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787359964.923056:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388ea00 x1874182595977472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923071:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595977472:0@lo:400: 00010000:00080000:2.0:1787359964.923080:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388dc00 x1874182595977984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923089:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595977984:0@lo:400: 00000100:00100000:2.0:1787359964.923097:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595977344:0@lo:400: 00010000:00080000:2.0:1787359964.923106:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388c000 x1874182595977856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923113:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595977856:0@lo:400: 00010000:00080000:2.0:1787359964.923120:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989039d0700 x1874182595978368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923127:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595978368:0@lo:400: 00000100:00100000:2.0:1787359964.923159:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595977088:0@lo:400: 00000100:00100000:2.0:1787359964.923167:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595977600:0@lo:400: 00010000:00080000:2.0:1787359964.923177:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388d180 x1874182595978112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923196:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595978112:0@lo:400: 00010000:00080000:2.0:1787359964.923207:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388d880 x1874182595977216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923214:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595977216:0@lo:400: 00010000:00080000:2.0:1787359964.923222:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388f480 x1874182595977728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923251:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595977728:0@lo:400: 00010000:00080000:2.0:1787359964.923261:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388c700 x1874182595978240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359964.923268:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595978240:0@lo:400: 00010000:00010000:0.0:1787359965.307104:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359965.441334:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595978496:0@lo:41: 00000100:00100000:2.0:1787359965.441404:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359965.441650:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978496 00000100:00100000:3.0:1787359965.441660:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978496 00000100:00100000:3.0:1787359965.441717:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787359965.441726:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595978496:12345-0@lo:41: 00000004:00000024:3.0:1787359965.441760:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787359965.448484:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595978496:12345-0@lo:41: Request processed in 6747us (7067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359965.448499:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787359965.454561:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595978496:0@lo:41: 10000000:01000000:0.0:1787359965.955932:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359965.955941:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a3d61e800 from 39 10000000:01000000:0.0:1787359965.955946:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359965.955994:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.956005:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.956016:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359965.956039:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978624:0@lo:101: 00000100:00100000:0.0:1787359965.956121:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.956175:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.956248:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978624 00000100:00100000:2.0:1787359965.956265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978624 00000100:00100000:2.0:1787359965.956317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787359965.956326:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595978624:12345-0@lo:101: 00010000:00010000:2.0:1787359965.956339:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359965.956352:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fe9d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.956375:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.956405:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.956415:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787359965.956456:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595978624:12345-0@lo:101: Request processed in 131us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.956463:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787359965.956514:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978624:0@lo:101: 00010000:00010000:0.0:1787359965.956528:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.956537:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359965.956591:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978752:0@lo:501: 00000100:00100000:0.0:1787359965.956627:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.956665:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.959490:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978752 00000100:00100000:2.0:1787359965.959503:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978752 00000100:00100000:2.0:1787359965.959562:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787359965.959572:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595978752:12345-0@lo:501: 00000100:00100000:2.0:1787359965.959767:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595978752:12345-0@lo:501: Request processed in 187us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.959775:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787359965.960408:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978752:0@lo:501: 00000100:00100000:0.0:1787359965.960458:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978880:0@lo:503: 00000100:00100000:0.0:1787359965.960504:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.960543:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359965.960951:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595978880 00000100:00100000:1.0:1787359965.960958:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595978880 00000100:00100000:1.0:1787359965.961001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787359965.961009:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595978880:12345-0@lo:503: 00000100:00100000:1.0:1787359965.961171:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595978880:12345-0@lo:503: Request processed in 162us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359965.961178:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787359965.961350:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595978880:0@lo:503: 00000100:00100000:0.0:1787359965.963328:0:9847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9847:1874182595979008:0@lo:502: 00000100:00100000:0.0:1787359965.963405:0:9847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.963440:0:9847:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359965.964014:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979008 00000100:00100000:1.0:1787359965.964023:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979008 00000100:00100000:1.0:1787359965.964142:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787359965.964161:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9847:x1874182595979008:12345-0@lo:502: 00000100:00100000:1.0:1787359965.965010:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9847:x1874182595979008:12345-0@lo:502: Request processed in 849us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359965.965020:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787359965.965417:0:9847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9847:1874182595979008:0@lo:502: 00000100:00100000:0.0:1787359965.965480:0:9847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9847:1874182595979136:0@lo:502: 00000100:00100000:0.0:1787359965.965524:0:9847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.965552:0:9847:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.965969:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979136 00000100:00100000:2.0:1787359965.965977:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979136 00000100:00100000:2.0:1787359965.966018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787359965.966028:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9847:x1874182595979136:12345-0@lo:502: 00000100:00100000:0.0:1787359965.966348:0:9847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9847:1874182595979136:0@lo:502: 00000040:00080000:0.0:1787359965.966373:0:9847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1787359965.967150:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:9847:x1874182595979136:12345-0@lo:502: Request processed in 1121us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.967161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000020:01000000:1.0:1787359965.967399:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787359965.967423:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787359965.967432:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359965.967443:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359965.967452:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787359965.967454:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787359965.967457:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787359965.967487:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359965.967495:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359965.967503:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359965.967520:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979264:0@lo:101: 00000100:00100000:1.0:1787359965.967561:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359965.967596:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.968345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979264 00000100:00100000:2.0:1787359965.968354:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979264 00000100:00100000:2.0:1787359965.968397:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787359965.968406:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595979264:12345-0@lo:101: 00010000:00010000:2.0:1787359965.968417:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359965.968440:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71feab expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.968462:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71feab expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.968472:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71feab expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.968481:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697e00, rc 0) 00000100:00100000:2.0:1787359965.968525:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979264:12345-0@lo:101: Request processed in 120us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.968531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787359965.969417:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979264:0@lo:101: 00010000:00010000:1.0:1787359965.969436:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359965.969454:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359965.969521:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979392:0@lo:501: 00000100:00100000:1.0:1787359965.969559:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359965.969583:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.970165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979392 00000100:00100000:2.0:1787359965.970172:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979392 00000100:00100000:2.0:1787359965.970207:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787359965.970217:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979392:12345-0@lo:501: 00000100:00100000:2.0:1787359965.970634:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979392:12345-0@lo:501: Request processed in 417us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.970641:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787359965.970718:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979392:0@lo:501: 00000100:00100000:0.0:1787359965.970754:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979520:0@lo:503: 00000100:00100000:0.0:1787359965.972145:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.972189:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359965.972530:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979520 00000100:00100000:1.0:1787359965.972538:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979520 00000100:00100000:1.0:1787359965.972586:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787359965.972596:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979520:12345-0@lo:503: 00000100:00100000:1.0:1787359965.972735:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979520:12345-0@lo:503: Request processed in 139us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359965.972744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787359965.972990:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979520:0@lo:503: 00000100:00100000:0.0:1787359965.974011:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9848:1874182595979648:0@lo:502: 00000100:00100000:0.0:1787359965.976384:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.976434:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359965.976619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979648 00000100:00100000:1.0:1787359965.976627:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979648 00000100:00100000:1.0:1787359965.976687:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787359965.976697:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9848:x1874182595979648:12345-0@lo:502: 00000100:00100000:1.0:1787359965.976856:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9848:x1874182595979648:12345-0@lo:502: Request processed in 160us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359965.976864:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787359965.977005:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9848:1874182595979648:0@lo:502: 00000020:01000000:0.0:1787359965.977046:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359965.977057:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359965.977059:0:9848:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787359965.977738:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787359965.977743:0:9848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359965.977777:0:9848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9848:1874182595979776:0@lo:502: 00000100:00100000:0.0:1787359965.977843:0:9848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359965.977876:0:9848:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.978169:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979776 00000100:00100000:2.0:1787359965.978176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979776 00000100:00100000:2.0:1787359965.978218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787359965.978546:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9848:x1874182595979776:12345-0@lo:502: 00000100:00100000:2.0:1787359965.978681:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:9848:x1874182595979776:12345-0@lo:502: Request processed in 455us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.978689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787359965.979461:0:9848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9848:1874182595979776:0@lo:502: 00000020:01000000:1.0:1787359965.979498:0:9848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359965.979504:0:9848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359965.979506:0:9848:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359965.979510:0:9848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787359965.979729:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787359965.979752:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787359965.979780:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.979791:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359965.979810:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787359965.979813:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a10f4d000 from 39 10000000:01000000:2.0:1787359965.979816:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359965.979843:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.979850:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.979858:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.979873:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979904:0@lo:101: 00000100:00100000:2.0:1787359965.979912:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.979943:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359965.980156:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595979904 00000100:00100000:0.0:1787359965.980163:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595979904 00000100:00100000:0.0:1787359965.980197:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787359965.980206:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595979904:12345-0@lo:101: 00010000:00010000:0.0:1787359965.980216:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359965.980243:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71feb9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.980274:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.980284:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359965.980293:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680a00, rc 0) 00000100:00100000:0.0:1787359965.980329:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595979904:12345-0@lo:101: Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359965.980335:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787359965.984039:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595979904:0@lo:101: 00010000:00010000:2.0:1787359965.984078:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.984092:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.984173:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980032:0@lo:501: 00000100:00100000:2.0:1787359965.984287:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.984332:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359965.987894:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980032 00000100:00100000:0.0:1787359965.987910:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980032 00000100:00100000:0.0:1787359965.987977:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787359965.987990:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595980032:12345-0@lo:501: 00000100:00100000:0.0:1787359965.988196:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595980032:12345-0@lo:501: Request processed in 208us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359965.988204:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787359965.988573:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980032:0@lo:501: 00000100:00100000:2.0:1787359965.988632:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980160:0@lo:503: 00000100:00100000:2.0:1787359965.988679:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.988709:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.988724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980160 00000100:00100000:2.0:1787359965.988728:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980160 00000100:00100000:2.0:1787359965.988755:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787359965.988775:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595980160:12345-0@lo:503: 00000100:00100000:2.0:1787359965.988872:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595980160:12345-0@lo:503: Request processed in 98us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.988879:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787359965.988920:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980160:0@lo:503: 00000100:00100000:2.0:1787359965.989158:0:9849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9849:1874182595980288:0@lo:502: 00000100:00100000:2.0:1787359965.989192:0:9849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.989212:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980288 00000100:00100000:2.0:1787359965.989216:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980288 00000100:00100000:2.0:1787359965.989753:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787359965.989775:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:9849:x1874182595980288:12345-0@lo:502: 00000100:00100000:2.0:1787359965.989978:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:9849:x1874182595980288:12345-0@lo:502: Request processed in 205us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.989985:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787359965.990028:0:9849:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.990044:0:9849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9849:1874182595980288:0@lo:502: 00000100:00100000:2.0:1787359965.990161:0:9849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9849:1874182595980416:0@lo:502: 00000100:00100000:2.0:1787359965.990196:0:9849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.990217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980416 00000100:00100000:2.0:1787359965.990222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980416 00000100:00100000:2.0:1787359965.990439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787359965.990448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:9849:x1874182595980416:12345-0@lo:502: 00000100:00100000:2.0:1787359965.990513:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:9849:x1874182595980416:12345-0@lo:502: Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.990519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787359965.990548:0:9849:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.990560:0:9849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9849:1874182595980416:0@lo:502: 00000040:00080000:2.0:1787359965.990579:0:9849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787359965.990649:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787359965.990668:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359965.990677:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.990686:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359965.990695:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787359965.990697:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a10f4d000 from 6 10000000:01000000:2.0:1787359965.990700:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787359965.990724:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.990731:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.990749:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.990945:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980544:0@lo:101: 00000100:00100000:2.0:1787359965.990975:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.990990:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.991002:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980544 00000100:00100000:2.0:1787359965.991006:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980544 00000100:00100000:2.0:1787359965.991029:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787359965.991034:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595980544:12345-0@lo:101: 00010000:00010000:2.0:1787359965.991042:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359965.991054:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fec7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991084:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fec7 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991094:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fec7 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991102:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696c00, rc 0) 00000100:00100000:2.0:1787359965.991131:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595980544:12345-0@lo:101: Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.991137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787359965.991166:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980544:0@lo:101: 00010000:00010000:2.0:1787359965.991177:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991196:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.991266:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980672:0@lo:256: 00000100:00100000:2.0:1787359965.991295:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.991308:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.991319:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980672 00000100:00100000:2.0:1787359965.991322:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980672 00000100:00100000:2.0:1787359965.991341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787359965.991347:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595980672:12345-0@lo:256: 20000000:01000000:2.0:1787359965.991358:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787359965.991374:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787359965.991377:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787359965.991460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595980672:12345-0@lo:256: Request processed in 113us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.991467:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787359965.991496:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980672:0@lo:256: 10000000:01000000:2.0:1787359965.991535:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787359965.991541:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991549:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359965.991555:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787359965.991557:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787359965.991559:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787359965.991579:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991586:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991593:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.991604:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980800:0@lo:101: 00000100:00100000:2.0:1787359965.991639:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.991653:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caece40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359965.991663:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980800 00000100:00100000:2.0:1787359965.991667:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980800 00000100:00100000:2.0:1787359965.991686:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787359965.991692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595980800:12345-0@lo:101: 00010000:00010000:2.0:1787359965.991698:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359965.991706:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fed5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991720:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991728:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.991736:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697a00, rc 0) 00000100:00100000:2.0:1787359965.991776:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595980800:12345-0@lo:101: Request processed in 83us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359965.991782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787359965.992566:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980800:0@lo:101: 00010000:00010000:2.0:1787359965.992582:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359965.992591:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359965.992659:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980928:0@lo:501: 00000100:00100000:2.0:1787359965.992689:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359965.992749:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caece40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359965.998457:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595980928 00000100:00100000:0.0:1787359965.998470:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595980928 00000100:00100000:3.0:1787359966.004113:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787359966.004128:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595980928:12345-0@lo:501: 00000100:00100000:3.0:1787359966.004343:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595980928:12345-0@lo:501: Request processed in 217us (11651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.004351:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787359966.004410:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595980928:0@lo:501: 00000100:00100000:3.0:1787359966.004459:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595981056:0@lo:503: 00000100:00100000:3.0:1787359966.004506:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.004536:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.004551:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981056 00000100:00100000:3.0:1787359966.004557:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981056 00000100:00100000:3.0:1787359966.004578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787359966.004590:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595981056:12345-0@lo:503: 00000100:00100000:3.0:1787359966.004677:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595981056:12345-0@lo:503: Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.004683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787359966.004719:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595981056:0@lo:503: 00000100:00100000:3.0:1787359966.005163:0:9850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9850:1874182595981184:0@lo:502: 00000100:00100000:3.0:1787359966.005197:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.005217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981184 00000100:00100000:3.0:1787359966.005221:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981184 00000100:00100000:3.0:1787359966.005264:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787359966.005271:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:9850:x1874182595981184:12345-0@lo:502: 00000100:00100000:3.0:1787359966.005344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:9850:x1874182595981184:12345-0@lo:502: Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.005351:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787359966.005379:0:9850:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.005392:0:9850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9850:1874182595981184:0@lo:502: 00000020:01000000:3.0:1787359966.005413:0:9850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787359966.005421:0:9850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787359966.005428:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359966.005436:0:9850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787359966.005440:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787359966.005445:0:9850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1787359966.005468:0:9850:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787359966.005471:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359966.005487:0:9850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9989034d4d28) 00000020:00000080:3.0:1787359966.005509:0:9850:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1787359966.005515:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787359966.005589:0:9850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787359966.005595:0:9850:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787359966.005603:0:9850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee71feea 00010000:00080000:3.0:1787359966.005641:0:9850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998902a5d800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787359966.005863:0:9850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1787359966.005982:0:9850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787359966.005993:0:9850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787359966.006151:0:9850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359966.006297:0:9850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359966.006429:0:9850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787359966.006523:0:9850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787359966.009485:0:9851:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787359966.009491:0:9851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787359966.015885:0:9850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787359966.015902:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787359966.015947:0:9850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787359966.015972:0:9850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71fef1 00000100:00080000:3.0:1787359966.015982:0:9850:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359966.015987:0:9850:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998902a5d800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:3.0:1787359966.016020:0:9850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a35057b80 x1874182595981312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787359966.016048:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595981312:0@lo:8: 00000100:00080000:0.0:1787359966.019364:0:9850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787359966.019563:0:9850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359966.019571:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359966.019573:0:9850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787359966.019577:0:9850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359966.019581:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359966.019582:0:9850:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787359966.019586:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787359966.019588:0:9850:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359966.019628:0:9850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9850:1874182595982720:0@lo:502: 00000100:00100000:3.0:1787359966.019927:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595981440:0@lo:400: 00000100:00100000:2.0:1787359966.020038:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595981568:0@lo:400: 00000100:00100000:1.0:1787359966.027623:0:9850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359966.027691:0:9850:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.027848:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982720 00000100:00100000:0.0:1787359966.027857:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982720 00000100:00100000:0.0:1787359966.027904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787359966.027914:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:9850:x1874182595982720:12345-0@lo:502: 00000100:00100000:0.0:1787359966.028062:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:9850:x1874182595982720:12345-0@lo:502: Request processed in 149us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.028070:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787359966.028302:0:9850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9850:1874182595982720:0@lo:502: 00000020:01000000:1.0:1787359966.028334:0:9850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359966.028341:0:9850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359966.028344:0:9850:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359966.028348:0:9850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1787359966.028472:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1787359966.028495:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787359966.028506:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.028528:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359966.028538:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359966.028540:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a0ffaa800 from 39 10000000:01000000:0.0:1787359966.028543:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359966.028572:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.028580:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.028589:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359966.028617:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595982848:0@lo:101: 00000100:00100000:0.0:1787359966.028651:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.028682:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359966.029155:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982848 00000100:00100000:1.0:1787359966.029162:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982848 00000100:00100000:1.0:1787359966.029206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787359966.029215:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595982848:12345-0@lo:101: 00010000:00010000:1.0:1787359966.029264:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359966.029279:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fef8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359966.029302:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359966.029314:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359966.029322:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00030800, rc 0) 00000100:00100000:1.0:1787359966.029361:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595982848:12345-0@lo:101: Request processed in 147us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359966.029367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787359966.029377:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595982848:0@lo:101: 00010000:00010000:0.0:1787359966.029390:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.029399:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359966.029468:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595982976:0@lo:501: 00000100:00100000:0.0:1787359966.029496:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.029575:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.029672:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.029694:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182595981952:0@lo:400: 00000100:00100000:3.0:1787359966.029715:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.029733:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182595982464:0@lo:400: 00000100:00100000:0.0:1787359966.031037:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981440 00000100:00100000:0.0:1787359966.031047:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981440 00000100:00100000:0.0:1787359966.031103:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981952 00000100:00100000:0.0:1787359966.031107:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981952 00000100:00100000:0.0:1787359966.031137:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787359966.031146:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595981440:12345-0@lo:400: 00000100:00100000:0.0:1787359966.031204:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182595981440:12345-0@lo:400: Request processed in 59us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.031212:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787359966.031253:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787359966.031367:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182595981952:12345-0@lo:400: 00000100:00100000:0.0:1787359966.031399:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182595981952:12345-0@lo:400: Request processed in 35us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.031405:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787359966.031903:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787359966.031956:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902914700 x1874182595981440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.031969:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182595981440:0@lo:400: 00010000:00080000:3.0:1787359966.031981:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902915f80 x1874182595981952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.031988:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182595981952:0@lo:400: 00000100:00100000:3.0:1787359966.032019:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595981696:0@lo:400: 00000100:00100000:3.0:1787359966.032052:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.032133:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595982208:0@lo:400: 00000100:00100000:3.0:1787359966.032161:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.032187:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787359966.032193:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595981824:0@lo:400: 00000100:00100000:3.0:1787359966.032217:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.032318:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595982336:0@lo:400: 00000100:00100000:3.0:1787359966.032344:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.032412:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982464 00000100:00100000:0.0:1787359966.032418:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982464 00000100:00100000:0.0:1787359966.032445:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981696 00000100:00100000:0.0:1787359966.032448:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981696 00000100:00100000:0.0:1787359966.032461:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787359966.032468:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182595982464:12345-0@lo:400: 00000100:00100000:0.0:1787359966.032508:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182595982464:12345-0@lo:400: Request processed in 41us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.032514:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787359966.032528:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787359966.032534:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595981696:12345-0@lo:400: 00000100:00100000:0.0:1787359966.032566:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595981696:12345-0@lo:400: Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.032587:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787359966.032919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982976 00000100:00100000:1.0:1787359966.032924:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982976 00000100:00100000:1.0:1787359966.032948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787359966.032954:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595982976:12345-0@lo:501: 00000100:00100000:1.0:1787359966.033100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595982976:12345-0@lo:501: Request processed in 145us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359966.033114:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787359966.033211:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595982976:0@lo:501: 00000100:00100000:0.0:1787359966.033278:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983104:0@lo:503: 00000100:00100000:0.0:1787359966.033319:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.033344:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.033357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983104 00000100:00100000:0.0:1787359966.033360:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983104 00000100:00100000:0.0:1787359966.033378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787359966.033384:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595983104:12345-0@lo:503: 00000100:00100000:0.0:1787359966.033463:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595983104:12345-0@lo:503: Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.033470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787359966.033510:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983104:0@lo:503: 00000100:00080000:2.0:1787359966.034437:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359966.034455:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982208 00000100:00100000:2.0:1787359966.034461:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982208 00000100:00100000:2.0:1787359966.034501:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982336 00000100:00100000:2.0:1787359966.034504:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982336 00000100:00100000:2.0:1787359966.034525:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359966.034533:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595982208:12345-0@lo:400: 00000100:00100000:2.0:1787359966.034584:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595982208:12345-0@lo:400: Request processed in 53us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.034591:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359966.034604:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359966.034621:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595982336:12345-0@lo:400: 00000100:00100000:2.0:1787359966.034650:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595982336:12345-0@lo:400: Request processed in 41us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.034656:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359966.034690:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.034725:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981824 00000100:00100000:2.0:1787359966.034730:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981824 00000100:00100000:2.0:1787359966.034753:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981568 00000100:00100000:2.0:1787359966.034757:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981568 00000100:00100000:2.0:1787359966.034783:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787359966.034789:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595981824:12345-0@lo:400: 00000100:00100000:2.0:1787359966.035035:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595981824:12345-0@lo:400: Request processed in 246us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.035042:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787359966.035055:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359966.035061:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595981568:12345-0@lo:400: 00000100:00100000:2.0:1787359966.035164:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595981568:12345-0@lo:400: Request processed in 103us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.035170:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359966.035202:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595981568:0@lo:400: 00000100:00100000:2.0:1787359966.035213:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595982080:0@lo:400: 00000100:00100000:2.0:1787359966.035276:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.035297:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982080 00000100:00100000:2.0:1787359966.035301:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982080 00000100:00100000:2.0:1787359966.035325:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787359966.035332:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595982080:12345-0@lo:400: 00000100:00100000:2.0:1787359966.035362:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595982080:12345-0@lo:400: Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.035368:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787359966.035395:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a3480 x1874182595982080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.035406:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595982080:0@lo:400: 00000100:00100000:2.0:1787359966.035420:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182595982592:0@lo:400: 00000100:00100000:2.0:1787359966.035445:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.035465:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595982592 00000100:00100000:2.0:1787359966.035468:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595982592 00000100:00100000:2.0:1787359966.035492:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787359966.035498:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182595982592:12345-0@lo:400: 00000100:00100000:2.0:1787359966.035527:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182595982592:12345-0@lo:400: Request processed in 29us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.035533:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787359966.035559:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5c000 x1874182595982592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.035568:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182595982592:0@lo:400: 00000100:00080000:0.0:1787359966.035936:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787359966.035941:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787359966.037245:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a3100 x1874182595982464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359966.037260:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182595982464:0@lo:400: 00000100:00100000:0.0:1787359966.037328:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.037459:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595981312 00000100:00100000:2.0:1787359966.037465:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595981312 00000100:00100000:2.0:1787359966.037538:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787359966.037544:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3657:x1874182595981312:12345-0@lo:8: 00010000:00080000:2.0:1787359966.037569:0:8450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787359966.037596:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee71ff06 00002000:00100000:2.0:1787359966.037619:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99890384c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787359966.037623:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787359966.037627:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787359966.037683:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787359966.037901:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787359966.037923:0:8450:0:(import.c:65:import_set_state_nolock()) ffff998903848000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359966.037970:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182595981312:12345-0@lo:8: Request processed in 425us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.037982:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787359966.038080:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595981824:0@lo:400: 00010000:00080000:3.0:1787359966.038095:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1180 x1874182595982336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.038105:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595982336:0@lo:400: 00010000:00080000:3.0:1787359966.038127:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902915180 x1874182595981696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.038136:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595981696:0@lo:400: 00010000:00080000:3.0:1787359966.038148:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a2680 x1874182595982208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.038155:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595982208:0@lo:400: 00000100:00100000:1.0:1787359966.038531:0:9853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9853:1874182595983232:0@lo:502: 00000100:00100000:1.0:1787359966.038580:0:9853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359966.038605:0:9853:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.042297:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983232 00000100:00100000:0.0:1787359966.042313:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983232 00000100:00100000:0.0:1787359966.042375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787359966.042386:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:9853:x1874182595983232:12345-0@lo:502: 00000100:00100000:0.0:1787359966.042556:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:9853:x1874182595983232:12345-0@lo:502: Request processed in 170us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.042573:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:2.0:1787359966.042740:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35057b80 x1874182595981312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.042752:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787359966.042770:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787359966.042779:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787359966.042783:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787359966.042786:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787359966.043142:0:9853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9853:1874182595983232:0@lo:502: 00000100:00100000:1.0:1787359966.043208:0:9853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9853:1874182595983360:0@lo:502: 00000100:00100000:0.0:1787359966.043269:0:9852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595983488:0@lo:700: 00000100:00100000:0.0:1787359966.043305:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.043333:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983488 00000100:00100000:0.0:1787359966.043337:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983488 00000100:00100000:0.0:1787359966.043381:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359966.043390:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9852:x1874182595983488:12345-0@lo:700: 00000100:00100000:0.0:1787359966.043419:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1874182595983616:0@lo:700: 00000100:00100000:0.0:1787359966.043446:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.043470:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cb40 going to sleep for 11 seconds 00000100:00080000:0.0:1787359966.043482:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787359966.043489:0:9852:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cc00 going to sleep for 11 seconds 00000004:00080000:0.0:1787359966.043498:0:9851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1787359966.043528:0:9853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359966.043550:0:9853:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06900 going to sleep for 11 seconds 00000004:00080000:0.0:1787359966.043557:0:9851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 244290330703ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787359966.043563:0:9851:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1787359966.044310:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787359966.044323:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182595981312:0@lo:8: 00000100:00100000:2.0:1787359966.044353:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983616 00000100:00100000:2.0:1787359966.044359:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983616 00000100:00100000:2.0:1787359966.044398:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787359966.044406:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1874182595983616:12345-0@lo:700: 00000100:00100000:0.0:1787359966.046636:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983360 00000100:00100000:0.0:1787359966.046648:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983360 00000100:00100000:0.0:1787359966.046708:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787359966.046717:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:9853:x1874182595983360:12345-0@lo:502: 00000100:00100000:0.0:1787359966.047196:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:9853:x1874182595983360:12345-0@lo:502: Request processed in 479us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.047204:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787359966.048544:0:9853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9853:1874182595983360:0@lo:502: 00000040:00080000:3.0:1787359966.048584:0:9853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1787359966.049027:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1787359966.049049:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359966.049059:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.049144:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359966.049153:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787359966.049156:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a0ffaa800 from 6 10000000:01000000:0.0:1787359966.049158:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787359966.049189:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.049197:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.049557:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359966.049579:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983744:0@lo:101: 00000100:00100000:0.0:1787359966.049641:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.049719:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000004:00080000:3.0:1787359966.050021:0:7462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:1.0:1787359966.051221:0:6538:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787359966.055352:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983744 00000100:00100000:2.0:1787359966.055370:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983744 00000100:00100000:3.0:1787359966.055992:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787359966.056004:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595983744:12345-0@lo:101: 00010000:00010000:3.0:1787359966.056019:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359966.056037:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516200/0x359a4e2aee71ff14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ff0d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.056183:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516200/0x359a4e2aee71ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ff0d expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.056197:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516200/0x359a4e2aee71ff14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ff0d expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.056207:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516200, rc 0) 00000100:00100000:3.0:1787359966.056398:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182595983744:12345-0@lo:101: Request processed in 396us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.056405:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787359966.056710:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983744:0@lo:101: 00010000:00010000:0.0:1787359966.056728:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.056738:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359966.056795:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983872:0@lo:256: 00000100:00100000:0.0:1787359966.056835:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.056872:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.056887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595983872 00000100:00100000:0.0:1787359966.056892:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595983872 00000100:00100000:0.0:1787359966.056919:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787359966.056926:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182595983872:12345-0@lo:256: 20000000:01000000:0.0:1787359966.056957:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787359966.056972:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787359966.056975:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787359966.057071:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182595983872:12345-0@lo:256: Request processed in 144us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.057341:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787359966.057379:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595983872:0@lo:256: 10000000:01000000:0.0:1787359966.057422:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787359966.057429:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.057438:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359966.057447:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787359966.057450:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787359966.057452:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359966.057473:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.057481:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359966.057490:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359966.057513:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984000:0@lo:101: 00000100:00100000:0.0:1787359966.057540:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.057561:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.058197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984000 00000100:00100000:3.0:1787359966.058211:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984000 00000100:00100000:3.0:1787359966.058385:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787359966.058395:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182595984000:12345-0@lo:101: 00010000:00010000:3.0:1787359966.058405:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359966.058416:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ff1b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.058435:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.058445:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.058453:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:3.0:1787359966.058495:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984000:12345-0@lo:101: Request processed in 102us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.058500:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787359966.058533:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984000:0@lo:101: 00010000:00010000:3.0:1787359966.058546:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.058554:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359966.058619:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984128:0@lo:501: 00000100:00100000:3.0:1787359966.058646:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.058670:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.058683:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984128 00000100:00100000:3.0:1787359966.058686:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984128 00000100:00100000:3.0:1787359966.058774:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787359966.058781:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984128:12345-0@lo:501: 00000100:00100000:3.0:1787359966.058892:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984128:12345-0@lo:501: Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.058899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787359966.060519:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1874182595983616:12345-0@lo:700: Request processed in 16108us (17066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359966.060531:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787359966.060592:0:8457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5ea00 x1874182595983616/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359966.060605:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1874182595983616:0@lo:700: 40000000:02000000:1.0:1787359966.060632:0:8457:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1787359966.063948:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984128:0@lo:501: 00000100:00100000:3.0:1787359966.064009:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984256:0@lo:503: 00000100:00100000:3.0:1787359966.064221:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.066304:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.067576:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984256 00000100:00100000:2.0:1787359966.067587:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984256 00000100:00100000:2.0:1787359966.067649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787359966.067660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984256:12345-0@lo:503: 00000100:00100000:2.0:1787359966.067897:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984256:12345-0@lo:503: Request processed in 238us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.067904:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787359966.067989:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984256:0@lo:503: 00000100:00100000:3.0:1787359966.068448:0:9854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9854:1874182595984384:0@lo:502: 00000100:00100000:3.0:1787359966.068492:0:9854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.068530:0:9854:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.068579:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984384 00000100:00100000:2.0:1787359966.068585:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984384 00000100:00100000:2.0:1787359966.068626:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787359966.068633:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:9854:x1874182595984384:12345-0@lo:502: 00000100:00100000:2.0:1787359966.068720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:9854:x1874182595984384:12345-0@lo:502: Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.068726:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787359966.068856:0:9854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9854:1874182595984384:0@lo:502: 00000020:01000000:3.0:1787359966.068878:0:9854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787359966.068885:0:9854:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787359966.068891:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359966.068893:0:9854:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787359966.068897:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787359966.068900:0:9854:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:3.0:1787359966.068922:0:9854:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787359966.068925:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359966.068939:0:9854:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9989034d0000) 00000020:00000080:3.0:1787359966.068961:0:9854:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1787359966.068967:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787359966.069043:0:9854:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787359966.069049:0:9854:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787359966.069061:0:9854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee71ff30 00010000:00080000:3.0:1787359966.069101:0:9854:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a2ecd7000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:3.0:1787359966.069411:0:9854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1787359966.069532:0:9854:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787359966.069544:0:9854:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787359966.069713:0:9854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359966.070022:0:9854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359966.070210:0:9854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787359966.070399:0:9854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787359966.074267:0:9855:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359966.074275:0:9855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:2.0:1787359966.074871:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787359966.075007:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595983488:12345-0@lo:700: Request processed in 31615us (31697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.075019:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787359966.075080:0:9852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5ca80 x1874182595983488/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359966.075106:0:9852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595983488:0@lo:700: 00000020:00000080:2.0:1787359966.079462:0:9854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787359966.079479:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787359966.079524:0:9854:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787359966.079550:0:9854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71ff37 00000100:00080000:2.0:1787359966.079561:0:9854:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787359966.079567:0:9854:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a2ecd7000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787359966.079604:0:9854:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9989039d3480 x1874182595984512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787359966.079671:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595984512:0@lo:8: 00000100:00100000:3.0:1787359966.079740:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.079788:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984512 00000100:00100000:3.0:1787359966.079794:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984512 00000100:00100000:3.0:1787359966.079825:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359966.079832:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3657:x1874182595984512:12345-0@lo:8: 00010000:00080000:3.0:1787359966.079862:0:8770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1787359966.079884:0:8770:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee71ff3e 00002000:00100000:3.0:1787359966.079897:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff998a2ecd2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787359966.079900:0:8770:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787359966.079903:0:8770:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787359966.079973:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787359966.079994:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998a2ecd5800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787359966.080845:0:9854:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787359966.080925:0:9854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359966.080930:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359966.080932:0:9854:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787359966.080936:0:9854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359966.080940:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359966.080941:0:9854:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787359966.080944:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787359966.080946:0:9854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787359966.080974:0:9854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9854:1874182595984640:0@lo:502: 00000100:00100000:2.0:1787359966.081029:0:9854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.081059:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984640 00000100:00100000:2.0:1787359966.081073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984640 00000100:00100000:2.0:1787359966.081116:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787359966.081124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:9854:x1874182595984640:12345-0@lo:502: 00000100:00100000:2.0:1787359966.081240:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:9854:x1874182595984640:12345-0@lo:502: Request processed in 101us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.081248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787359966.081296:0:9854:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec600 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.081315:0:9854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:9854:1874182595984640:0@lo:502: 00000020:01000000:2.0:1787359966.081335:0:9854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359966.081339:0:9854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359966.081341:0:9854:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787359966.081344:0:9854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787359966.081390:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787359966.081407:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787359966.081417:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359966.081427:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359966.081436:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787359966.081438:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a3bac8000 from 1 10000000:01000000:2.0:1787359966.081441:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787359966.081461:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359966.081469:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359966.081477:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359966.081488:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984768:0@lo:101: 00000100:00100000:2.0:1787359966.081519:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.081532:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.091143:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182595984512:12345-0@lo:8: Request processed in 11298us (11391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.091159:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359966.091375:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984768 00000100:00100000:3.0:1787359966.091385:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984768 00000100:00100000:3.0:1787359966.091430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787359966.091439:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182595984768:12345-0@lo:101: 00010000:00010000:3.0:1787359966.091461:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359966.091480:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ff45 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.091506:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.091518:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359966.091527:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517400, rc 0) 00000100:00100000:3.0:1787359966.091584:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182595984768:12345-0@lo:101: Request processed in 146us (10065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.091590:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:3.0:1787359966.091665:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989039d3480 x1874182595984512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.091675:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787359966.091685:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787359966.091691:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787359966.091696:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787359966.091699:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ecd7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787359966.091708:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787359966.091714:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182595984512:0@lo:8: 00000100:00100000:2.0:1787359966.092442:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984768:0@lo:101: 00010000:00010000:2.0:1787359966.092460:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359966.092463:0:9855:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1787359966.092470:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359966.092521:0:9855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 244339294738ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787359966.092526:0:9855:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787359966.092532:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984896:0@lo:501: 00000100:00100000:2.0:1787359966.092570:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.092595:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3caec600 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.092621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595984896 00000100:00100000:2.0:1787359966.092626:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595984896 00000100:00100000:2.0:1787359966.092662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787359966.092669:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182595984896:12345-0@lo:501: 00000100:00100000:2.0:1787359966.092738:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182595984896:12345-0@lo:501: Request processed in 70us (168us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359966.092745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787359966.092789:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595984896:0@lo:501: 10000000:01000000:2.0:1787359966.092812:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787359966.092819:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359966.092826:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359966.096423:0:9852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787359966.096454:0:9852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985152:0@lo:7: 00000100:00100000:0.0:1787359966.096516:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.096544:0:9852:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.097168:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359966.097184:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595985024:0@lo:13: 00000100:00100000:2.0:1787359966.097221:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.097289:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985152 00000100:00100000:2.0:1787359966.097295:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985152 00000100:00100000:2.0:1787359966.097344:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359966.097353:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595985152:12345-0@lo:7: 00000100:00100000:0.0:1787359966.097542:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985024 00000100:00100000:0.0:1787359966.097547:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985024 00000100:00100000:0.0:1787359966.097572:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359966.097579:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1874182595985024:12345-0@lo:13: 00002000:00000024:0.0:1787359966.097594:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:0.0:1787359966.097653:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1874182595985024:12345-0@lo:13: Request processed in 73us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.097660:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:3.0:1787359966.101216:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787359966.103626:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359966.103647:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595985280:0@lo:13: 00000100:00100000:3.0:1787359966.103706:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787359966.103743:0:9857:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787359966.103783:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595985408:0@lo:7: 00000100:00100000:0.0:1787359966.104497:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985280 00000100:00100000:0.0:1787359966.104508:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985280 00000100:00100000:0.0:1787359966.104600:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359966.104621:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182595985280:12345-0@lo:13: 00002000:00000024:0.0:1787359966.104640:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:0.0:1787359966.107956:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182595985280:12345-0@lo:13: Request processed in 3342us (4243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.107969:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787359966.108011:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787359966.110005:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902914000 x1874182595985280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359966.110029:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595985280:0@lo:13: 00002000:00080000:2.0:1787359966.110720:0:8450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787359966.110726:0:8450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787359966.110925:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595985152:12345-0@lo:7: Request processed in 13570us (14406us total) trans 0 rc 0/0 00010000:00080000:0.0:1787359966.110932:0:9852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5df80 x1874182595985152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.110935:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359966.110943:0:9852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985152:0@lo:7: 00000004:00080000:0.0:1787359966.110954:0:9852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787359966.110986:0:9852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985536:0@lo:5: 00010000:00080000:2.0:1787359966.110989:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5ca80 x1874182595985024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.111002:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595985024:0@lo:13: 00000100:00100000:0.0:1787359966.111017:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.111527:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985536 00000100:00100000:2.0:1787359966.111535:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985536 00000100:00100000:2.0:1787359966.111576:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359966.111585:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595985536:12345-0@lo:5: 00002000:00080000:2.0:1787359966.111618:0:8770:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787359966.111766:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359966.111944:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595985536:12345-0@lo:5: Request processed in 359us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.111951:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787359966.111963:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985408 00000100:00100000:2.0:1787359966.111967:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985408 00000100:00100000:2.0:1787359966.111988:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787359966.112002:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9857:x1874182595985408:12345-0@lo:7: 00000100:00100000:3.0:1787359966.116447:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.117022:0:9852:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00010000:00080000:0.0:1787359966.117347:0:9852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5df80 x1874182595985536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359966.117364:0:9852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985536:0@lo:5: 00000004:00080000:0.0:1787359966.117378:0:9852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787359966.117422:0:9852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985664:0@lo:5: 00000100:00100000:0.0:1787359966.117472:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.117494:0:9852:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.119470:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985664 00000100:00100000:3.0:1787359966.119481:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985664 00000100:00100000:3.0:1787359966.119531:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359966.119541:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9852:x1874182595985664:12345-0@lo:5: 00002000:00080000:3.0:1787359966.119580:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787359966.122659:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9852:x1874182595985664:12345-0@lo:5: Request processed in 3113us (5181us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787359966.122671:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787359966.122673:0:9852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5df80 x1874182595985664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359966.122690:0:9852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9852:1874182595985664:0@lo:5: 00000004:00080000:0.0:1787359966.122711:0:9852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1787359966.122747:0:9852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9852:1874182595985792:0@lo:900: 00000100:00100000:0.0:1787359966.122781:0:9852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359966.122803:0:9852:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359966.122819:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985792 00000100:00100000:0.0:1787359966.122825:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985792 00000100:00100000:0.0:1787359966.122860:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359966.122869:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9852:x1874182595985792:12345-0@lo:900: 00000100:00100000:0.0:1787359966.122914:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9852:x1874182595985792:12345-0@lo:900: Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359966.122920:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787359966.122947:0:9852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5fb80 x1874182595985792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359966.122957:0:9852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9852:1874182595985792:0@lo:900: 00002000:00080000:2.0:1787359966.128645:0:8770:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787359966.128654:0:8770:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787359966.129451:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9857:x1874182595985408:12345-0@lo:7: Request processed in 17445us (17687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359966.129462:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787359966.132983:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902916300 x1874182595985408/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.133002:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595985408:0@lo:7: 00000004:00080000:3.0:1787359966.133018:0:9857:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787359966.133329:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595985920:0@lo:5: 00000100:00100000:1.0:1787359966.133390:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359966.133430:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06180 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.133646:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595985920 00000100:00100000:3.0:1787359966.133653:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595985920 00000100:00100000:3.0:1787359966.133705:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359966.133714:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9857:x1874182595985920:12345-0@lo:5: 00002000:00080000:3.0:1787359966.133738:0:8447:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787359966.133741:0:8447:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1787359966.142734:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1787359966.142753:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787359966.142772:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787359966.142969:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9857:x1874182595985920:12345-0@lo:5: Request processed in 9251us (9574us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787359966.142979:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787359966.143046:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feddf80 x1874182595985920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359966.143058:0:9857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787359966.143188:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feddf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595985920:0@lo:5: 00000004:00080000:3.0:1787359966.143204:0:9857:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787359966.143336:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595986048:0@lo:700: 00000100:00100000:3.0:1787359966.143373:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.143410:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986048 00000100:00100000:3.0:1787359966.143415:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986048 00000100:00100000:3.0:1787359966.143462:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359966.143471:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9857:x1874182595986048:12345-0@lo:700: 00000100:00100000:3.0:1787359966.143616:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359966.159332:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9857:x1874182595986048:12345-0@lo:700: Request processed in 15853us (15949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359966.159344:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787359966.159493:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902916300 x1874182595986048/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.159507:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595986048:0@lo:700: 00000004:02000040:2.0:1787359966.178281:0:9857:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1787359966.186917:0:9857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595986176:0@lo:5: 00000100:00100000:3.0:1787359966.187404:0:9857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359966.187553:0:9857:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359966.187595:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986176 00000100:00100000:2.0:1787359966.187603:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986176 00000100:00100000:2.0:1787359966.187664:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359966.187673:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9857:x1874182595986176:12345-0@lo:5: 00002000:00080000:3.0:1787359966.200510:0:8448:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787359966.200529:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1787359966.208309:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9857:x1874182595986176:12345-0@lo:5: Request processed in 20628us (20897us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787359966.208324:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787359966.211962:0:9857:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989039d0000 x1874182595986176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359966.211985:0:9857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9857:1874182595986176:0@lo:5: 00000004:00080000:2.0:1787359966.212003:0:9857:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1787359966.330368:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787359966.607777:0:9898:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787359967.355189:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359967.485754:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359967.485788:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595986304:0@lo:41: 00000100:00100000:2.0:1787359967.485882:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359967.485974:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986304 00000100:00100000:2.0:1787359967.485983:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986304 00000100:00100000:2.0:1787359967.486039:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359967.486061:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595986304:12345-0@lo:41: 00000004:00000024:2.0:1787359967.486106:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787359967.486162:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595986304:12345-0@lo:41: Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359967.486170:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359967.486272:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595986304:0@lo:41: 00000020:00000004:2.0:1787359967.837458:0:9950:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787359967.837750:0:9950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787359968.379198:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359968.510417:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595986432:0@lo:13: 00000100:00100000:2.0:1787359968.510612:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359968.510691:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359968.510701:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595986560:0@lo:13: 00000100:00100000:2.0:1787359968.510727:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359968.513399:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986432 00000100:00100000:0.0:1787359968.513411:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986432 00000100:00100000:0.0:1787359968.513533:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986560 00000100:00100000:0.0:1787359968.513538:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986560 00000100:00100000:0.0:1787359968.513559:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359968.513568:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595986432:12345-0@lo:13: 00002000:00000024:0.0:1787359968.513607:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787359968.513708:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359968.514756:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595986432:12345-0@lo:13: Request processed in 1185us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359968.514766:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359968.514798:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359968.514807:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595986560:12345-0@lo:13: 00002000:00000024:0.0:1787359968.514822:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359968.514866:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595986560:12345-0@lo:13: Request processed in 61us (4138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359968.514872:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787359968.515379:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902916300 x1874182595986560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359968.515397:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595986560:0@lo:13: 00010000:00080000:3.0:1787359968.516089:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989039d3480 x1874182595986432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359968.516104:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595986432:0@lo:13: 00000001:00080000:3.0:1787359968.888543:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1787359969.401376:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359970.426684:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359970.558637:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787359970.558661:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595986688:0@lo:41: 00000100:00100000:1.0:1787359970.558738:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359970.562541:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986688 00000100:00100000:0.0:1787359970.562555:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986688 00000100:00100000:0.0:1787359970.562620:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787359970.562631:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595986688:12345-0@lo:41: 00000004:00000024:0.0:1787359970.562665:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787359970.562752:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595986688:12345-0@lo:41: Request processed in 123us (4013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359970.562760:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787359970.562900:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595986688:0@lo:41: 00000020:00000004:1.0:1787359970.756926:0:10052:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787359970.757207:0:10052:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787359971.452476:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359971.577718:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359971.577742:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595987200:0@lo:400: 00000100:00100000:3.0:1787359971.577784:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595987072:0@lo:400: 00000100:00100000:2.0:1787359971.577801:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.577812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359971.577852:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595987328:0@lo:400: 00000100:00100000:0.0:1787359971.577862:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595986944:0@lo:400: 00000100:00100000:3.0:1787359971.582508:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595987584:0@lo:400: 00000100:00100000:3.0:1787359971.582573:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.582614:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595988096:0@lo:400: 00000100:00100000:3.0:1787359971.582637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.582670:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595988608:0@lo:13: 00000100:00100000:3.0:1787359971.582699:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.582746:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595987712:0@lo:400: 00000100:00100000:3.0:1787359971.582770:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.582787:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595988224:0@lo:400: 00000100:00100000:3.0:1787359971.582807:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359971.584923:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987072 00000100:00100000:3.0:1787359971.584935:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987072 00000100:00100000:3.0:1787359971.584973:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987584 00000100:00100000:3.0:1787359971.584976:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987584 00000100:00100000:3.0:1787359971.585002:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988096 00000100:00100000:3.0:1787359971.585005:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988096 00000100:00100000:3.0:1787359971.585020:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987712 00000100:00100000:3.0:1787359971.585022:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987712 00000100:00100000:3.0:1787359971.585034:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988224 00000100:00100000:3.0:1787359971.585036:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988224 00000100:00100000:3.0:1787359971.585053:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787359971.585062:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595987072:12345-0@lo:400: 00000100:00100000:3.0:1787359971.585148:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595987072:12345-0@lo:400: Request processed in 86us (7334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359971.585156:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787359971.585174:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787359971.585181:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595987584:12345-0@lo:400: 00000100:00100000:3.0:1787359971.585210:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595987584:12345-0@lo:400: Request processed in 30us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359971.585216:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787359971.585254:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787359971.585261:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595988096:12345-0@lo:400: 00000100:00100000:2.0:1787359971.586798:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359971.586843:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595987840:0@lo:400: 00000100:00100000:2.0:1787359971.586888:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359971.586918:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595988352:0@lo:400: 00000100:00100000:2.0:1787359971.586956:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359971.587029:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987328 00000100:00100000:2.0:1787359971.587038:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987328 00000100:00100000:1.0:1787359971.587166:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987840 00000100:00100000:1.0:1787359971.587171:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987840 00000100:00100000:1.0:1787359971.587203:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988352 00000100:00100000:1.0:1787359971.587206:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988352 00000100:00100000:1.0:1787359971.587317:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359971.587328:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595987840:12345-0@lo:400: 00000100:00100000:1.0:1787359971.587383:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595987840:12345-0@lo:400: Request processed in 58us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.587390:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359971.587406:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787359971.587412:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595988352:12345-0@lo:400: 00000100:00100000:1.0:1787359971.587438:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595988352:12345-0@lo:400: Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.587444:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787359971.587483:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880e00 x1874182595987840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.587496:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595987840:0@lo:400: 00010000:00080000:1.0:1787359971.587511:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903882d80 x1874182595988352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.587519:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787359971.587533:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595988352:0@lo:400: 00000100:00100000:2.0:1787359971.587613:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359971.587623:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595987712:12345-0@lo:400: 00000100:00100000:2.0:1787359971.587675:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595987712:12345-0@lo:400: Request processed in 54us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359971.587681:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359971.587699:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359971.587706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595988224:12345-0@lo:400: 00000100:00100000:2.0:1787359971.587862:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595988224:12345-0@lo:400: Request processed in 156us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359971.587869:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359971.587885:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787359971.587891:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595987328:12345-0@lo:400: 00000100:00100000:2.0:1787359971.587924:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182595987328:12345-0@lo:400: Request processed in 34us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359971.587930:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787359971.588008:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903883b80 x1874182595987712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.588033:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595987712:0@lo:400: 00010000:00080000:1.0:1787359971.588050:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880380 x1874182595988224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.588057:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595988224:0@lo:400: 00010000:00080000:1.0:1787359971.588222:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903882680 x1874182595987328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359971.588338:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987200 00000100:00100000:2.0:1787359971.588344:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987200 00000100:00100000:2.0:1787359971.588374:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787359971.588380:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595987200:12345-0@lo:400: 00000100:00100000:2.0:1787359971.588415:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595987200:12345-0@lo:400: Request processed in 36us (10614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359971.588421:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787359971.588628:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182595987328:0@lo:400: 00000100:00100000:1.0:1787359971.588643:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595987200:0@lo:400: 00000100:00100000:0.0:1787359971.589165:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988608 00000100:00100000:0.0:1787359971.589170:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988608 00000100:00100000:0.0:1787359971.589382:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359971.589391:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595988608:12345-0@lo:13: 00002000:00000024:0.0:1787359971.589413:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359971.589455:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595988608:12345-0@lo:13: Request processed in 66us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359971.589461:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359971.589563:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595988096:12345-0@lo:400: Request processed in 4301us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359971.589571:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787359971.589603:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359971.589608:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787359971.589611:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787359971.589614:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787359971.589640:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5fb80 x1874182595988608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359971.589656:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595988608:0@lo:13: 00010000:00080000:3.0:1787359971.589668:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eddf480 x1874182595987072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359971.589675:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595987072:0@lo:400: 00010000:00080000:3.0:1787359971.589687:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903882300 x1874182595987584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359971.589712:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595987584:0@lo:400: 00010000:00080000:3.0:1787359971.589725:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903883800 x1874182595988096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359971.589733:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595988096:0@lo:400: 00000100:00100000:1.0:1787359971.593388:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359971.593454:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595986816:0@lo:13: 00000100:00100000:1.0:1787359971.593500:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359971.593527:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986816 00000100:00100000:1.0:1787359971.593534:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986816 00000100:00100000:1.0:1787359971.593596:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787359971.593605:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595986816:12345-0@lo:13: 00002000:00000024:1.0:1787359971.593628:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359971.593666:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595986816:12345-0@lo:13: Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.593673:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787359971.593695:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787359971.593720:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1180 x1874182595986816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.593744:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787359971.593763:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595986816:0@lo:13: 00000100:00100000:1.0:1787359971.593784:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595987456:0@lo:400: 00000100:00100000:1.0:1787359971.593809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359971.593834:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987456 00000100:00100000:1.0:1787359971.593838:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987456 00000100:00100000:1.0:1787359971.593863:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787359971.593870:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595987456:12345-0@lo:400: 00000100:00100000:1.0:1787359971.593904:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595987456:12345-0@lo:400: Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.593910:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787359971.593938:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595987456:0@lo:400: 00000100:00100000:1.0:1787359971.593945:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595987968:0@lo:400: 00000100:00100000:1.0:1787359971.593968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359971.593988:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595987968 00000100:00100000:1.0:1787359971.593991:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595987968 00000100:00100000:1.0:1787359971.594020:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787359971.594026:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595987968:12345-0@lo:400: 00000100:00100000:1.0:1787359971.594054:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595987968:12345-0@lo:400: Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.594060:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787359971.594093:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787359971.594109:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880a80 x1874182595987968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.594118:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595987968:0@lo:400: 00000100:00100000:1.0:1787359971.594124:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595988480:0@lo:400: 00000100:00100000:1.0:1787359971.594145:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359971.594172:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988480 00000100:00100000:1.0:1787359971.594176:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988480 00000100:00100000:1.0:1787359971.594200:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787359971.594205:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595988480:12345-0@lo:400: 00000100:00100000:1.0:1787359971.594263:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595988480:12345-0@lo:400: Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359971.594269:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787359971.594297:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903881880 x1874182595988480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359971.594307:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595988480:0@lo:400: 00000100:00100000:3.0:1787359971.598017:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595986944 00000100:00100000:3.0:1787359971.598029:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595986944 00000100:00100000:3.0:1787359971.598083:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787359971.598093:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182595986944:12345-0@lo:400: 00000100:00100000:3.0:1787359971.598178:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182595986944:12345-0@lo:400: Request processed in 87us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359971.598185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787359971.598304:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595986944:0@lo:400: 00000020:00000004:1.0:1787359971.746533:0:10100:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787359971.746544:0:10100:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1787359972.360634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359972.361389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574964864 00000100:00100000:2.0:1787359972.361413:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574964864 00000100:00100000:2.0:1787359972.361454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:2.0:1787359972.361462:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1874182574964864:12345-192.168.206.11@tcp:250: 00010000:00080000:2.0:1787359972.361489:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 89778f7a-f278-4db1-8669-35e9fc15f33b@192.168.206.11@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787359972.361518:0:6524:0:(genops.c:1385:class_connect()) connect: client 89778f7a-f278-4db1-8669-35e9fc15f33b, cookie 0x359a4e2aee71ff53 00000100:00080000:2.0:1787359972.361663:0:6524:0:(import.c:65:import_set_state_nolock()) ffff99890384b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359972.362588:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+5:2398:x1874182574964864:12345-192.168.206.11@tcp:250: Request processed in 1111us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.362599:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:0.0:1787359972.384697:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.384841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574964992 00000100:00100000:3.0:1787359972.384860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574964992 00000100:00100000:3.0:1787359972.384914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:3.0:1787359972.384924:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+5:6160:x1874182574964992:12345-192.168.206.11@tcp:101: 00010000:00010000:3.0:1787359972.384939:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359972.384957:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eee95 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.384984:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.384995:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.385022:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:3.0:1787359972.385088:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+6:6160:x1874182574964992:12345-192.168.206.11@tcp:101: Request processed in 164us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.385094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:3.0:1787359972.393728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359972.393827:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965120 00000100:00100000:2.0:1787359972.393837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965120 00000100:00100000:2.0:1787359972.393902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1787359972.393912:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+6:6160:x1874182574965120:12345-192.168.206.11@tcp:501: 00000100:00100000:2.0:1787359972.394793:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+6:6160:x1874182574965120:12345-192.168.206.11@tcp:501: Request processed in 878us (1080us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359972.394803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1787359972.396988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359972.397423:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965248 00000100:00100000:0.0:1787359972.397455:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965248 00000100:00100000:0.0:1787359972.397510:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:0.0:1787359972.397520:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+6:6160:x1874182574965248:12345-192.168.206.11@tcp:101: 00010000:00010000:0.0:1787359972.397535:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359972.397552:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eee9c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359972.397591:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359972.397602:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359972.397612:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681a00, rc 0) 00000100:00100000:0.0:1787359972.397798:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+7:6160:x1874182574965248:12345-192.168.206.11@tcp:101: Request processed in 278us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.397806:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:0.0:1787359972.406917:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359972.407214:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965376 00000100:00100000:2.0:1787359972.407365:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965376 00000100:00100000:2.0:1787359972.407552:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:2.0:1787359972.407563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+7:6160:x1874182574965376:12345-192.168.206.11@tcp:501: 00000100:00100000:2.0:1787359972.407741:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6160:x1874182574965376:12345-192.168.206.11@tcp:501: Request processed in 179us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.407749:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:1.0:1787359972.413616:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359972.413700:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965504 00000100:00100000:0.0:1787359972.413710:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965504 00000100:00100000:0.0:1787359972.413764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:0.0:1787359972.413773:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6160:x1874182574965504:12345-192.168.206.11@tcp:503: 00000100:00100000:0.0:1787359972.413923:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6160:x1874182574965504:12345-192.168.206.11@tcp:503: Request processed in 150us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.413932:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:0.0:1787359972.419989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359972.424005:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965632 00000100:00100000:2.0:1787359972.424582:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965632 00000100:00100000:2.0:1787359972.424726:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:2.0:1787359972.424737:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6178:x1874182574965632:12345-192.168.206.11@tcp:502: 00000100:00100000:2.0:1787359972.424902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6178:x1874182574965632:12345-192.168.206.11@tcp:502: Request processed in 166us (4920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.424910:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:1.0:1787359972.471606:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.471725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965760 00000100:00100000:3.0:1787359972.471735:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965760 00000100:00100000:3.0:1787359972.471790:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:3.0:1787359972.471801:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6178:x1874182574965760:12345-192.168.206.11@tcp:502: 00000100:00100000:3.0:1787359972.471968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6178:x1874182574965760:12345-192.168.206.11@tcp:502: Request processed in 167us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.471977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 189 00010000:00010000:0.0:1787359972.475448:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359972.491262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359972.491412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574965888 00000100:00100000:2.0:1787359972.491421:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574965888 00000100:00100000:2.0:1787359972.491474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:2.0:1787359972.491484:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6160:x1874182574965888:12345-192.168.206.11@tcp:101: 00010000:00010000:2.0:1787359972.491498:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359972.491516:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696800/0x359a4e2aee71ff68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eeecd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359972.491542:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696800/0x359a4e2aee71ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeecd expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359972.491553:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696800/0x359a4e2aee71ff68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeecd expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359972.491562:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696800, rc 0) 00000100:00100000:2.0:1787359972.491627:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6160:x1874182574965888:12345-192.168.206.11@tcp:101: Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.491634:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:2.0:1787359972.496444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359972.496539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966016 00000100:00100000:0.0:1787359972.496562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966016 00000100:00100000:0.0:1787359972.496627:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:0.0:1787359972.496637:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6160:x1874182574966016:12345-192.168.206.11@tcp:256: 20000000:01000000:0.0:1787359972.496662:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787359972.496680:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787359972.496684:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787359972.496688:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787359972.496690:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787359972.496693:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1787359972.498921:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6160:x1874182574966016:12345-192.168.206.11@tcp:256: Request processed in 2276us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.498935:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:1.0:1787359972.506262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.506438:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966144 00000100:00100000:3.0:1787359972.506456:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966144 00000100:00100000:3.0:1787359972.506548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:3.0:1787359972.506563:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6160:x1874182574966144:12345-192.168.206.11@tcp:101: 00010000:00010000:3.0:1787359972.506627:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359972.506652:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eeed4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.506691:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.506705:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359972.506739:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:3.0:1787359972.507409:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6160:x1874182574966144:12345-192.168.206.11@tcp:101: Request processed in 845us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.507419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:2.0:1787359972.513660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359972.514605:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966272 00000100:00100000:0.0:1787359972.514620:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966272 00000100:00100000:0.0:1787359972.514841:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:0.0:1787359972.514853:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6160:x1874182574966272:12345-192.168.206.11@tcp:501: 00000100:00100000:0.0:1787359972.515417:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6160:x1874182574966272:12345-192.168.206.11@tcp:501: Request processed in 563us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.515428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:1.0:1787359972.520912:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.521043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966400 00000100:00100000:3.0:1787359972.521053:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966400 00000100:00100000:3.0:1787359972.521118:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1787359972.521128:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6160:x1874182574966400:12345-192.168.206.11@tcp:503: 00000100:00100000:3.0:1787359972.521569:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6160:x1874182574966400:12345-192.168.206.11@tcp:503: Request processed in 440us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.521587:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:1.0:1787359972.531423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359972.531504:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966528 00000100:00100000:0.0:1787359972.531515:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966528 00000100:00100000:0.0:1787359972.531571:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:0.0:1787359972.531591:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6183:x1874182574966528:12345-192.168.206.11@tcp:502: 00000100:00100000:0.0:1787359972.531734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6183:x1874182574966528:12345-192.168.206.11@tcp:502: Request processed in 144us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.531742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:2.0:1787359972.548768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.556966:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966656 00000100:00100000:3.0:1787359972.556980:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966656 00000100:00100000:2.0:1787359972.563518:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:2.0:1787359972.563543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6183:x1874182574966656:12345-192.168.206.11@tcp:502: 00000100:00100000:2.0:1787359972.563823:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6183:x1874182574966656:12345-192.168.206.11@tcp:502: Request processed in 293us (15064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.563832:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:1.0:1787359972.574691:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359972.574737:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359972.574822:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966784 00000100:00100000:3.0:1787359972.574832:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966784 00000100:00100000:3.0:1787359972.574882:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967040 00000100:00100000:3.0:1787359972.574886:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967040 00000100:00100000:3.0:1787359972.574912:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787359972.574921:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874182574966784:12345-192.168.206.11@tcp:38: 00010000:00080000:3.0:1787359972.574947:0:6531:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787359972.574996:0:6531:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee71ff76 00000004:00100000:3.0:1787359972.575020:0:6531:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787359972.575213:0:6531:0:(import.c:65:import_set_state_nolock()) ffff998903b1d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359972.575439:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:0.0:1787359972.575459:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182574967040:12345-192.168.206.11@tcp:38: 00010000:00080000:0.0:1787359972.575476:0:9449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1787359972.575513:0:9449:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee71ff7d 00000004:00100000:0.0:1787359972.575525:0:9449:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787359972.575688:0:9449:0:(import.c:65:import_set_state_nolock()) ffff99890373c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359972.575754:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574967040:12345-192.168.206.11@tcp:38: Request processed in 293us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.575762:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:0.0:1787359972.576498:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574966784:12345-192.168.206.11@tcp:38: Request processed in 1574us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.576507:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787359972.601591:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595988736:0@lo:41: 00000100:00100000:1.0:1787359972.601661:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359972.602106:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988736 00000100:00100000:2.0:1787359972.602114:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988736 00000100:00100000:2.0:1787359972.602164:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787359972.602174:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595988736:12345-0@lo:41: 00000004:00000024:2.0:1787359972.602206:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787359972.602390:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595988736:12345-0@lo:41: Request processed in 217us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359972.602399:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787359972.602490:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595988736:0@lo:41: 00010000:00010000:2.0:1787359973.497454:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359973.591375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359973.591464:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967296 00000100:00100000:0.0:1787359973.591475:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967296 00000100:00100000:0.0:1787359973.591551:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1787359973.591563:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967296:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1787359973.591611:0:9449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787359973.592860:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967296:12345-192.168.206.11@tcp:41: Request processed in 1293us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359973.592871:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00080000:1.0:1787359973.593008:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359973.600491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359973.600909:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967168 00000100:00100000:0.0:1787359973.600919:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967168 00000100:00100000:0.0:1787359973.600991:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1787359973.601002:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574967168:12345-192.168.206.11@tcp:41: 00000004:00000024:0.0:1787359973.601036:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787359973.601090:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574967168:12345-192.168.206.11@tcp:41: Request processed in 90us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359973.601113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787359973.602078:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359973.602164:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574966912 00000100:00100000:2.0:1787359973.602170:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574966912 00000100:00100000:2.0:1787359973.602209:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787359973.602254:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574966912:12345-192.168.206.11@tcp:41: 00000004:00000024:2.0:1787359973.602275:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787359973.602333:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574966912:12345-192.168.206.11@tcp:41: Request processed in 82us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359973.602340:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00080000:3.0:1787359973.603194:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787359973.604990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359973.605187:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967424 00000100:00100000:0.0:1787359973.605196:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967424 00000100:00100000:0.0:1787359973.605281:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1787359973.605291:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967424:12345-192.168.206.11@tcp:40: 00000100:00100000:0.0:1787359973.605379:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967424:12345-192.168.206.11@tcp:40: Request processed in 89us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359973.605386:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787359973.625349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359973.625406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359973.625440:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359973.625489:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359973.625526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967936 00000100:00100000:2.0:1787359973.625536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967936 00000100:00100000:2.0:1787359973.625594:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:2.0:1787359973.625605:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574967936:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359973.625675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574967936:12345-192.168.206.11@tcp:400: Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359973.625683:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:1.0:1787359973.626035:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967552 00000100:00100000:1.0:1787359973.626040:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967552 00000100:00100000:1.0:1787359973.626068:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967680 00000100:00100000:1.0:1787359973.626071:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967680 00000100:00100000:1.0:1787359973.626086:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787359973.626091:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182574967552:12345-192.168.206.11@tcp:8: 00010000:00080000:1.0:1787359973.626117:0:8770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1787359973.626142:0:8770:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee71ff84 00002000:00100000:1.0:1787359973.626153:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1121de3d-8714-4863-bc5d-127112ba378a/ffff998903731800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787359973.626169:0:8770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787359973.626371:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787359973.626396:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998903736800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359973.626432:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574967552:12345-192.168.206.11@tcp:8: Request processed in 339us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359973.626440:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787359973.626455:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787359973.626460:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182574967680:12345-192.168.206.11@tcp:8: 00010000:00080000:1.0:1787359973.626475:0:8770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1787359973.626491:0:8770:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee71ff8b 00002000:00100000:1.0:1787359973.626496:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1121de3d-8714-4863-bc5d-127112ba378a/ffff998903731000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787359973.626506:0:8770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787359973.626629:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787359973.626645:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998903734000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359973.626667:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574967680:12345-192.168.206.11@tcp:8: Request processed in 206us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359973.626674:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787359973.626700:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787359973.626718:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595988864:0@lo:13: 00000100:00100000:1.0:1787359973.626758:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359973.626816:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988864 00000100:00100000:1.0:1787359973.626820:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988864 00000100:00100000:1.0:1787359973.626863:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787359973.626871:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595988864:12345-0@lo:13: 00002000:00000024:1.0:1787359973.626883:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359973.626918:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595988864:12345-0@lo:13: Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359973.626924:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787359973.626954:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1180 x1874182595988864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359973.626970:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595988864:0@lo:13: 00000100:00080000:3.0:1787359973.627814:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359973.628034:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574967808 00000100:00100000:0.0:1787359973.628041:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574967808 00000100:00100000:0.0:1787359973.628087:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787359973.628096:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967808:12345-192.168.206.11@tcp:900: 00000100:00100000:0.0:1787359973.628157:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574967808:12345-192.168.206.11@tcp:900: Request processed in 62us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359973.628163:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787359973.630118:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595988992:0@lo:13: 00000100:00100000:0.0:1787359973.630189:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359973.630560:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595988992 00000100:00100000:1.0:1787359973.630584:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595988992 00000100:00100000:1.0:1787359973.630640:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359973.630648:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595988992:12345-0@lo:13: 00002000:00000024:1.0:1787359973.630668:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1787359973.631283:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359973.636705:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595988992:12345-0@lo:13: Request processed in 6045us (6504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359973.636720:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359973.638475:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359973.638576:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968064 00000100:00100000:3.0:1787359973.638585:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968064 00000100:00100000:3.0:1787359973.638639:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787359973.638649:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574968064:12345-192.168.206.11@tcp:33: 00010000:00080000:0.0:1787359973.641638:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388dc00 x1874182595988992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359973.641666:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595988992:0@lo:13: 00000004:00080000:2.0:1787359973.683480:0:6534:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 44750us 00000004:00200000:1.0:1787359973.719331:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787359973.719584:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:6160:x1874182574968064:12345-192.168.206.11@tcp:33: Request processed in 80920us (81103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359973.719600:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787359973.929475:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359973.929655:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968192 00000100:00100000:0.0:1787359973.929664:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968192 00000100:00100000:0.0:1787359973.929721:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1787359973.929730:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:6201:x1874182574968192:12345-192.168.206.11@tcp:101: 00010000:00010000:0.0:1787359973.929762:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359973.929827:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681000/0x359a4e2aee71ff92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef05 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.929889:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.929901:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.929915:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359973.929957:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787359973.929961:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787359973.929974:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.929997:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681000/0x359a4e2aee71ff92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef05 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.930014:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef05 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359973.930021:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712b00) 00010000:00010000:0.0:1787359973.930024:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787359973.930027:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680000, rc 0) 00000100:00100000:0.0:1787359973.930181:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:6201:x1874182574968192:12345-192.168.206.11@tcp:101: Request processed in 450us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359973.930188:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00010000:00010000:0.0:1787359974.526029:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359975.545492:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359975.676962:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595989120:0@lo:41: 00000100:00100000:3.0:1787359975.677029:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359975.677438:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989120 00000100:00100000:1.0:1787359975.677446:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989120 00000100:00100000:1.0:1787359975.677505:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787359975.677513:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595989120:12345-0@lo:41: 00000004:00000024:1.0:1787359975.677543:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787359975.677607:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595989120:12345-0@lo:41: Request processed in 94us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359975.677614:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787359975.681015:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595989120:0@lo:41: 00000100:00100000:0.0:1787359976.113337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359976.113438:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968320 00000100:00100000:2.0:1787359976.113448:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968320 00000100:00100000:2.0:1787359976.113541:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:2.0:1787359976.113580:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:6253:x1874182574968320:12345-192.168.206.11@tcp:41: 00000004:00000024:2.0:1787359976.113617:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787359976.113686:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:6253:x1874182574968320:12345-192.168.206.11@tcp:41: Request processed in 136us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359976.113693:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00080000:3.0:1787359976.114518:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359976.116376:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359976.116590:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968448 00000100:00100000:2.0:1787359976.116600:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968448 00000100:00100000:2.0:1787359976.116713:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:2.0:1787359976.116725:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968448:12345-192.168.206.11@tcp:41: 00000004:00000024:2.0:1787359976.116761:0:9449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787359976.116830:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968448:12345-192.168.206.11@tcp:41: Request processed in 107us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359976.116837:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00080000:3.0:1787359976.117042:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787359976.120288:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359976.120385:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968576 00000100:00100000:2.0:1787359976.120396:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968576 00000100:00100000:2.0:1787359976.120467:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787359976.120479:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968576:12345-192.168.206.11@tcp:13: 00002000:00000024:2.0:1787359976.120511:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359976.120591:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968576:12345-192.168.206.11@tcp:13: Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359976.120599:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00080000:3.0:1787359976.120676:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359976.124849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359976.124954:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968704 00000100:00100000:2.0:1787359976.124964:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968704 00000100:00100000:2.0:1787359976.125034:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1787359976.125054:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968704:12345-192.168.206.11@tcp:13: 00002000:00000024:2.0:1787359976.125085:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359976.125153:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1121de3d-8714-4863-bc5d-127112ba378a+6:6253:x1874182574968704:12345-192.168.206.11@tcp:13: Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359976.125168:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00080000:3.0:1787359976.125286:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787359976.569459:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359976.699400:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359976.699423:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595989248:0@lo:13: 00000100:00100000:0.0:1787359976.699492:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.699565:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989248 00000100:00100000:0.0:1787359976.699572:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989248 00000100:00100000:0.0:1787359976.699632:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359976.699641:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595989248:12345-0@lo:13: 00002000:00000024:0.0:1787359976.699662:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359976.699716:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182595989248:12345-0@lo:13: Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.699722:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787359976.699760:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5df80 x1874182595989248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359976.699777:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182595989248:0@lo:13: 00000100:00080000:0.0:1787359976.699822:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787359976.703787:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595989632:0@lo:400: 00000100:00100000:0.0:1787359976.703865:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.703900:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595990144:0@lo:400: 00000100:00100000:0.0:1787359976.703924:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.703939:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182595990656:0@lo:400: 00000100:00100000:0.0:1787359976.703962:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.703983:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787359976.703988:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595989504:0@lo:400: 00000100:00100000:0.0:1787359976.704007:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.704033:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595990016:0@lo:400: 00000100:00100000:0.0:1787359976.704053:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.704066:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595990528:0@lo:400: 00000100:00100000:0.0:1787359976.704082:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.704103:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989632 00000100:00100000:0.0:1787359976.704110:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989632 00000100:00100000:0.0:1787359976.704153:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787359976.704173:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595989632:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704223:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182595989632:12345-0@lo:400: Request processed in 50us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704254:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787359976.704275:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990144 00000100:00100000:0.0:1787359976.704279:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990144 00000100:00100000:0.0:1787359976.704306:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990656 00000100:00100000:0.0:1787359976.704309:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990656 00000100:00100000:0.0:1787359976.704322:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989504 00000100:00100000:0.0:1787359976.704325:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989504 00000100:00100000:0.0:1787359976.704336:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990016 00000100:00100000:0.0:1787359976.704339:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990016 00000100:00100000:0.0:1787359976.704349:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990528 00000100:00100000:0.0:1787359976.704351:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990528 00000100:00100000:0.0:1787359976.704364:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787359976.704370:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595990144:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704402:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182595990144:12345-0@lo:400: Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704408:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787359976.704419:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787359976.704425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182595990656:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704449:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182595990656:12345-0@lo:400: Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704461:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787359976.704473:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787359976.704478:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595989504:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704503:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182595989504:12345-0@lo:400: Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704509:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787359976.704519:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787359976.704525:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595990016:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704547:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182595990016:12345-0@lo:400: Request processed in 23us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704564:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787359976.704575:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787359976.704581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595990528:12345-0@lo:400: 00000100:00100000:0.0:1787359976.704606:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182595990528:12345-0@lo:400: Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.704612:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787359976.704636:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359976.704640:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787359976.704965:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182595989504:0@lo:400: 00000100:00100000:0.0:1787359976.704982:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182595990016:0@lo:400: 00000100:00100000:0.0:1787359976.704992:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182595990528:0@lo:400: 00000100:00100000:0.0:1787359976.705000:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182595989632:0@lo:400: 00010000:00080000:0.0:1787359976.705012:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef32d80 x1874182595990144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359976.705035:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182595990144:0@lo:400: 00010000:00080000:0.0:1787359976.705046:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef33100 x1874182595990656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359976.705053:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182595990656:0@lo:400: 00000100:00100000:0.0:1787359976.705127:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595989760:0@lo:400: 00000100:00100000:0.0:1787359976.706286:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706331:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595990272:0@lo:400: 00000100:00100000:0.0:1787359976.706365:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706392:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595990784:0@lo:400: 00000100:00100000:0.0:1787359976.706412:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706449:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787359976.706455:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595989376:0@lo:400: 00000100:00100000:0.0:1787359976.706479:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706503:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595989888:0@lo:400: 00000100:00100000:0.0:1787359976.706523:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706539:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595990400:0@lo:400: 00000100:00100000:0.0:1787359976.706569:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.706598:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990272 00000100:00100000:0.0:1787359976.706605:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990272 00000100:00100000:0.0:1787359976.706643:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990784 00000100:00100000:0.0:1787359976.706646:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990784 00000100:00100000:0.0:1787359976.706657:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990400 00000100:00100000:0.0:1787359976.706659:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990400 00000100:00100000:0.0:1787359976.706671:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359976.706679:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595990272:12345-0@lo:400: 00000100:00100000:0.0:1787359976.706759:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595990272:12345-0@lo:400: Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.706766:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787359976.706781:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787359976.706787:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595990784:12345-0@lo:400: 00000100:00100000:2.0:1787359976.706913:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989376 00000100:00100000:2.0:1787359976.706917:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989376 00000100:00100000:2.0:1787359976.706944:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787359976.706950:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182595989376:12345-0@lo:400: 00000100:00100000:2.0:1787359976.706981:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182595989376:12345-0@lo:400: Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359976.706986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787359976.707960:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359976.707973:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595990400:12345-0@lo:400: 00000100:00100000:3.0:1787359976.708025:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595990400:12345-0@lo:400: Request processed in 57us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359976.708032:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359976.708099:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989888 00000100:00100000:3.0:1787359976.708104:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989888 00000100:00100000:3.0:1787359976.708135:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359976.708140:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595989888:12345-0@lo:400: 00000100:00100000:3.0:1787359976.708182:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595989888:12345-0@lo:400: Request processed in 41us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359976.708187:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359976.708206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595989760 00000100:00100000:3.0:1787359976.708210:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595989760 00000100:00100000:3.0:1787359976.708248:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359976.708255:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595989760:12345-0@lo:400: 00000100:00100000:3.0:1787359976.708306:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182595989760:12345-0@lo:400: Request processed in 51us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359976.708312:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787359976.708339:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359976.708344:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359976.708371:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595989376:0@lo:400: 00000100:00100000:3.0:1787359976.708384:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595989888:0@lo:400: 00010000:00080000:3.0:1787359976.708403:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef31500 x1874182595990400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359976.708413:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595990400:0@lo:400: 00000100:00100000:3.0:1787359976.708426:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182595989760:0@lo:400: 00010000:00080000:3.0:1787359976.708436:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef31880 x1874182595990272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359976.708444:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595990272:0@lo:400: 00000100:00100000:0.0:1787359976.711359:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595990784:12345-0@lo:400: Request processed in 4561us (4934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.711374:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359976.713489:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595990912:0@lo:13: 00000100:00100000:2.0:1787359976.713576:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359976.713686:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595990912 00000100:00100000:0.0:1787359976.713693:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595990912 00000100:00100000:0.0:1787359976.713923:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787359976.713933:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595990912:12345-0@lo:13: 00002000:00000024:0.0:1787359976.713953:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359976.714005:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595990912:12345-0@lo:13: Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359976.714012:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787359976.714083:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef32300 x1874182595990912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359976.714100:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595990912:0@lo:13: 00010000:00080000:3.0:1787359976.714336:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef33480 x1874182595990784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359976.714347:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595990784:0@lo:400: 00010000:00010000:2.0:1787359977.602708:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359977.722880:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595991040:0@lo:41: 00000100:00100000:0.0:1787359977.722955:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359977.723340:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991040 00000100:00100000:2.0:1787359977.723348:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991040 00000100:00100000:2.0:1787359977.723404:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359977.723414:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595991040:12345-0@lo:41: 00000004:00000024:2.0:1787359977.723447:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787359977.726134:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595991040:12345-0@lo:41: Request processed in 2713us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359977.726147:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787359977.726485:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595991040:0@lo:41: 00000001:00100000:3.0:1787359977.726610:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00010000:00010000:0.0:1787359978.619553:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359978.751969:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595991168:0@lo:13: 00000100:00100000:1.0:1787359978.752060:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359978.755268:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991168 00000100:00100000:2.0:1787359978.755292:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991168 00000100:00100000:2.0:1787359978.755355:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359978.755367:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595991168:12345-0@lo:13: 00002000:00000024:2.0:1787359978.755400:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359978.755494:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595991168:12345-0@lo:13: Request processed in 130us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359978.755502:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787359978.755522:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359978.755571:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388f480 x1874182595991168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359978.755591:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595991168:0@lo:13: 00000100:00100000:2.0:1787359978.757159:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359978.757180:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595991296:0@lo:13: 00000100:00100000:2.0:1787359978.757313:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359978.757399:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991296 00000100:00100000:2.0:1787359978.757406:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991296 00000100:00100000:2.0:1787359978.757457:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359978.757474:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595991296:12345-0@lo:13: 00002000:00000024:2.0:1787359978.757493:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359978.757534:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595991296:12345-0@lo:13: Request processed in 62us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359978.757556:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787359978.757578:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359978.757602:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388f480 x1874182595991296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359978.757618:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595991296:0@lo:13: 00000001:00100000:1.0:1787359978.765294:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000001:00100000:3.0:1787359978.773731:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000100:00100000:0.0:1787359978.862313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359978.862351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359978.862382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359978.862496:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968960 00000100:00100000:2.0:1787359978.862507:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968960 00000100:00100000:2.0:1787359978.862580:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787359978.862593:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574968960:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359978.862686:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574968960:12345-192.168.206.11@tcp:400: Request processed in 95us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359978.862694:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1787359978.863018:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359978.863041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359978.863061:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969088 00000100:00100000:0.0:1787359978.863071:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969088 00000100:00100000:0.0:1787359978.863100:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787359978.863108:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574969088:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1787359978.863142:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574969088:12345-192.168.206.11@tcp:400: Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359978.863149:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00080000:2.0:1787359978.863319:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359978.863323:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359978.863427:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969216 00000100:00100000:3.0:1787359978.863438:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969216 00000100:00100000:3.0:1787359978.863487:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969344 00000100:00100000:3.0:1787359978.863491:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969344 00000100:00100000:3.0:1787359978.863511:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1787359978.863518:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574969216:12345-192.168.206.11@tcp:400: 00000100:00100000:3.0:1787359978.863651:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574969216:12345-192.168.206.11@tcp:400: Request processed in 133us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359978.863659:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1787359978.863673:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787359978.863680:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574969344:12345-192.168.206.11@tcp:400: 00000100:00100000:3.0:1787359978.863821:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574969344:12345-192.168.206.11@tcp:400: Request processed in 140us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359978.863828:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00080000:2.0:1787359978.864094:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359978.864098:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359978.865817:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574968832 00000100:00100000:1.0:1787359978.865830:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574968832 00000100:00100000:1.0:1787359978.865933:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:1.0:1787359978.865944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574968832:12345-192.168.206.11@tcp:400: 00000100:00100000:1.0:1787359978.866022:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574968832:12345-192.168.206.11@tcp:400: Request processed in 80us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359978.866029:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 199 00000001:02000400:1.0:1787359979.156192:0:10198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787359979.645823:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787359979.782692:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00010000:00010000:3.0:1787359980.668636:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359980.794586:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359980.794611:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595991424:0@lo:41: 00000100:00100000:3.0:1787359980.794678:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359980.794799:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991424 00000100:00100000:1.0:1787359980.794807:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991424 00000100:00100000:1.0:1787359980.794869:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787359980.794879:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595991424:12345-0@lo:41: 00000004:00000024:1.0:1787359980.794909:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787359980.794962:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182595991424:12345-0@lo:41: Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359980.794982:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359980.795053:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182595991424:0@lo:41: 00010000:00010000:3.0:1787359981.689328:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359981.817833:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595991552:0@lo:13: 00000100:00100000:2.0:1787359981.817898:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359981.819606:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991552 00000100:00100000:1.0:1787359981.819619:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991552 00000100:00100000:1.0:1787359981.819679:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359981.819691:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595991552:12345-0@lo:13: 00002000:00000024:1.0:1787359981.819720:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359981.819783:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595991552:12345-0@lo:13: Request processed in 96us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359981.819790:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787359981.819885:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787359981.819936:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0000 x1874182595991552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.819954:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595991552:0@lo:13: 00000100:00100000:2.0:1787359981.822137:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595991808:0@lo:400: 00000100:00100000:2.0:1787359981.822195:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822254:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182595992320:0@lo:400: 00000100:00100000:2.0:1787359981.822279:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822297:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182595992832:0@lo:400: 00000100:00100000:2.0:1787359981.822316:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822337:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787359981.822342:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595991936:0@lo:400: 00000100:00100000:2.0:1787359981.822366:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822404:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595992448:0@lo:400: 00000100:00100000:2.0:1787359981.822425:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822440:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595992960:0@lo:400: 00000100:00100000:2.0:1787359981.822471:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.822501:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991808 00000100:00100000:2.0:1787359981.822507:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991808 00000100:00100000:2.0:1787359981.822552:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992320 00000100:00100000:2.0:1787359981.822556:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992320 00000100:00100000:2.0:1787359981.822577:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992832 00000100:00100000:2.0:1787359981.822579:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992832 00000100:00100000:2.0:1787359981.822591:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992448 00000100:00100000:2.0:1787359981.822594:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992448 00000100:00100000:2.0:1787359981.822618:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992960 00000100:00100000:2.0:1787359981.822622:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992960 00000100:00100000:2.0:1787359981.822638:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787359981.822645:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595991808:12345-0@lo:400: 00000100:00100000:2.0:1787359981.822698:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182595991808:12345-0@lo:400: Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.822705:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787359981.822721:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787359981.822728:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182595992320:12345-0@lo:400: 00000100:00100000:2.0:1787359981.822754:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182595992320:12345-0@lo:400: Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.822759:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787359981.822769:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787359981.822775:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182595992832:12345-0@lo:400: 00000100:00100000:2.0:1787359981.822796:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182595992832:12345-0@lo:400: Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.822800:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787359981.822810:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787359981.822815:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595992448:12345-0@lo:400: 00000100:00100000:2.0:1787359981.822837:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182595992448:12345-0@lo:400: Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.822842:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787359981.822851:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787359981.822886:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595992960:12345-0@lo:400: 00000100:00100000:2.0:1787359981.822915:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182595992960:12345-0@lo:400: Request processed in 59us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.822936:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787359981.822977:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359981.822981:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359981.823004:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182595992064:0@lo:400: 00000100:00100000:2.0:1787359981.823035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823053:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595992576:0@lo:400: 00000100:00100000:2.0:1787359981.823073:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823091:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595993088:0@lo:400: 00000100:00100000:2.0:1787359981.823110:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823137:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787359981.823144:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595991680:0@lo:400: 00000100:00100000:2.0:1787359981.823168:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823188:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595992192:0@lo:400: 00000100:00100000:2.0:1787359981.823208:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823244:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595992704:0@lo:400: 00000100:00100000:2.0:1787359981.823266:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.823288:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992576 00000100:00100000:2.0:1787359981.823292:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992576 00000100:00100000:2.0:1787359981.823320:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993088 00000100:00100000:2.0:1787359981.823323:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993088 00000100:00100000:2.0:1787359981.823335:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992704 00000100:00100000:2.0:1787359981.823338:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992704 00000100:00100000:2.0:1787359981.823350:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787359981.823356:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595992576:12345-0@lo:400: 00000100:00100000:2.0:1787359981.823391:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595992576:12345-0@lo:400: Request processed in 34us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.823397:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787359981.823408:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359981.823414:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595993088:12345-0@lo:400: 00000100:00100000:2.0:1787359981.823441:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595993088:12345-0@lo:400: Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.823455:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787359981.823467:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359981.823473:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595992704:12345-0@lo:400: 00000100:00100000:2.0:1787359981.823499:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595992704:12345-0@lo:400: Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.823504:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359981.823522:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991680 00000100:00100000:2.0:1787359981.823537:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991680 00000100:00100000:2.0:1787359981.823561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787359981.823567:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182595991680:12345-0@lo:400: 00000100:00100000:2.0:1787359981.823593:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182595991680:12345-0@lo:400: Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.823618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787359981.823658:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359981.823661:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359981.823714:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5500 x1874182595992448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.823728:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182595992448:0@lo:400: 00010000:00080000:2.0:1787359981.823753:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5c00 x1874182595992960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.823762:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182595992960:0@lo:400: 00000100:00100000:2.0:1787359981.823772:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182595991808:0@lo:400: 00000100:00100000:2.0:1787359981.823780:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182595992320:0@lo:400: 00000100:00100000:2.0:1787359981.823789:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182595992832:0@lo:400: 00000100:00100000:2.0:1787359981.823840:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992064 00000100:00100000:2.0:1787359981.823871:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992064 00000100:00100000:2.0:1787359981.823907:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787359981.823914:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182595992064:12345-0@lo:400: 00000100:00100000:2.0:1787359981.823956:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182595992064:12345-0@lo:400: Request processed in 43us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.823971:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787359981.824008:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595991680:0@lo:400: 00010000:00080000:2.0:1787359981.824020:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd7100 x1874182595992704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.824028:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595992704:0@lo:400: 00000100:00100000:2.0:1787359981.824048:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182595992064:0@lo:400: 00010000:00080000:2.0:1787359981.824058:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd6a00 x1874182595992576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.824077:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595992576:0@lo:400: 00010000:00080000:2.0:1787359981.824088:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd4000 x1874182595993088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.824096:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595993088:0@lo:400: 00000100:00100000:2.0:1787359981.824251:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595991936 00000100:00100000:2.0:1787359981.824256:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595991936 00000100:00100000:2.0:1787359981.824297:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595992192 00000100:00100000:2.0:1787359981.824300:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595992192 00000100:00100000:2.0:1787359981.824351:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787359981.824359:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595991936:12345-0@lo:400: 00000100:00100000:2.0:1787359981.824406:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182595991936:12345-0@lo:400: Request processed in 48us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.824412:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787359981.824425:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787359981.824431:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595992192:12345-0@lo:400: 00000100:00100000:2.0:1787359981.824463:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595992192:12345-0@lo:400: Request processed in 32us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.824468:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787359981.824505:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182595991936:0@lo:400: 00000100:00100000:2.0:1787359981.824554:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595992192:0@lo:400: 00000100:00100000:2.0:1787359981.831249:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359981.831278:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595993216:0@lo:13: 00000100:00100000:2.0:1787359981.831350:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359981.831448:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993216 00000100:00100000:3.0:1787359981.831456:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993216 00000100:00100000:3.0:1787359981.831520:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787359981.831540:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595993216:12345-0@lo:13: 00002000:00000024:3.0:1787359981.831562:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359981.831606:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182595993216:12345-0@lo:13: Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359981.831613:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787359981.833047:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0700 x1874182595993216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359981.833071:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182595993216:0@lo:13: 00010000:00010000:2.0:1787359982.715839:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359982.841379:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359982.841404:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595993344:0@lo:41: 00000100:00100000:0.0:1787359982.841482:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359982.841557:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993344 00000100:00100000:0.0:1787359982.841564:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993344 00000100:00100000:0.0:1787359982.841619:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359982.841632:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595993344:12345-0@lo:41: 00000004:00000024:0.0:1787359982.841665:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787359982.841710:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182595993344:12345-0@lo:41: Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359982.841717:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359982.841757:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182595993344:0@lo:41: 00000020:00000080:1.0:1787359983.069109:0:10345:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc6463000 20000000:00000080:1.0:1787359983.069125:0:10345:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a3fea5400 uarg=0000000000000000 20000000:01000000:1.0:1787359983.069174:0:10345:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787359983.069177:0:10345:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787359983.069179:0:10345:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787359983.069183:0:10345:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787359983.069188:0:10345:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787359983.069279:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787359983.069283:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787359983.080081:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787359983.080361:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787359983.080399:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787359983.080416:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1787359983.080430:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787359983.080433:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787359983.082559:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1787359983.082855:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1787359983.082884:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1787359983.082900:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1787359983.082911:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787359983.082914:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787359983.088722:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787359983.094615:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787359983.094650:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787359983.094664:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787359983.094679:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787359983.094682:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787359983.096146:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787359983.098963:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787359983.098994:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787359983.099006:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787359983.099029:0:10345:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787359983.099031:0:10345:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787359983.099540:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787359983.099721:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787359983.099743:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787359983.099759:0:10345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1787359983.099771:0:10345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787359983.099789:0:10345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099808:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099815:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099822:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099829:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71feab expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099835:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099841:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099848:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099854:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099871:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099880:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099888:0:10345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099894:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099930:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.099946:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 9 pid: 6526 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.099959:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993472:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787359983.100094:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.100103:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.100112:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993600:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787359983.100146:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.100164:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 23 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.100174:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993728:0@lo:104: 00000100:00100000:2.0:1787359983.100418:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359983.100491:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.100499:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.100507:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993856:0@lo:104: 00000100:00100000:2.0:1787359983.100542:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359983.100871:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.100880:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 23 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.100889:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993984:0@lo:104: 00000100:00100000:2.0:1787359983.100911:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.101015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993728 00000100:00100000:1.0:1787359983.101022:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993728 00000100:00100000:1.0:1787359983.101056:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993856 00000100:00100000:1.0:1787359983.101059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993856 00000100:00100000:1.0:1787359983.101073:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359983.101089:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10345:x1874182595993728:12345-0@lo:104: 00010000:00010000:1.0:1787359983.101100:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.101188:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359983.101194:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10345:x1874182595993728:12345-0@lo:104: Request processed in 107us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.101200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359983.101216:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359983.101222:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10345:x1874182595993856:12345-0@lo:104: 00010000:00010000:1.0:1787359983.101345:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101472:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101481:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101490:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994112:0@lo:104: 00000100:00100000:2.0:1787359983.101534:0:10345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359983.101553:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101561:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101568:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994240:0@lo:104: 00010000:00010000:2.0:1787359983.101593:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101601:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 23 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101607:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994368:0@lo:104: 00010000:00010000:2.0:1787359983.101628:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101636:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 23 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101642:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994496:0@lo:104: 00010000:00010000:2.0:1787359983.101662:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101669:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 23 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101676:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994624:0@lo:104: 00010000:00010000:2.0:1787359983.101694:0:10345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.101708:0:10345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.101716:0:10345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994752:0@lo:104: 00000100:00100000:2.0:1787359983.101746:0:10345:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359983.101767:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993728:0@lo:104: 00000100:00100000:2.0:1787359983.101775:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993856:0@lo:104: 00010000:00010000:0.0:1787359983.101853:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359983.101860:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101868:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.101872:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101880:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.101892:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.101898:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.101930:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101937:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.101955:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101962:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697000/0x359a4e2aee71ff45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff4c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101974:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359983.101978:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101983:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.101985:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.101991:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.101997:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.102001:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.102022:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102028:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.102042:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102049:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ff1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71ff22 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102058:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359983.102060:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359983.102061:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359983.102073:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595994880:0@lo:103: 00000100:00100000:0.0:1787359983.102103:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.102143:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595995008:0@lo:103: 00000100:00100000:0.0:1787359983.102175:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.102210:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994880 00000100:00100000:0.0:1787359983.102215:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994880 00010000:00010000:0.0:1787359983.102265:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 24 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.102287:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995008 00000100:00100000:0.0:1787359983.102290:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995008 00010000:00010000:0.0:1787359983.102302:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 25 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.102319:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787359983.102326:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+25:3661:x1874182595994880:12345-0@lo:103: 00010000:00010000:0.0:1787359983.102336:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359983.102347:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 25 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102355:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 25 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102368:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517400/0x359a4e2aee71ff4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71ff45 expref: 25 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102382:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359983.102413:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28ec3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182595994880:12345-0@lo:103: Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.102420:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787359983.102457:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359983.102463:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3658:x1874182595995008:12345-0@lo:103: 00010000:00010000:0.0:1787359983.102470:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359983.102475:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102483:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102493:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee71ff22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71ff1b expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.102501:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359983.102537:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3658:x1874182595995008:12345-0@lo:103: Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.102544:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359983.102575:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182595995008:0@lo:103: 00000100:00100000:0.0:1787359983.102608:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595994880:0@lo:103: 00010000:00010000:1.0:1787359983.102822:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787359983.102830:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10345:x1874182595993856:12345-0@lo:104: Request processed in 1608us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.102837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359983.102860:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787359983.102877:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.103132:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.103150:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.103160:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.103169:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.103177:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595993984 00000100:00100000:1.0:1787359983.103180:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595993984 00000100:00100000:1.0:1787359983.103202:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994112 00000100:00100000:1.0:1787359983.103205:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994112 00000100:00100000:1.0:1787359983.103214:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994240 00000100:00100000:1.0:1787359983.103216:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994240 00000100:00100000:1.0:1787359983.103394:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994368 00000100:00100000:1.0:1787359983.103407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994368 00000100:00100000:1.0:1787359983.103422:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994496 00000100:00100000:1.0:1787359983.103424:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994496 00000100:00100000:1.0:1787359983.103433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994624 00000100:00100000:1.0:1787359983.103435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994624 00000100:00100000:1.0:1787359983.103443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595994752 00000100:00100000:1.0:1787359983.103445:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595994752 00000100:00100000:1.0:1787359983.103458:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359983.103464:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:10345:x1874182595993984:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103475:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.103607:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359983.103655:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359983.103662:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+9:10345:x1874182595993984:12345-0@lo:104: Request processed in 198us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.103669:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359983.103685:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359983.103691:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989034a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:10345:x1874182595994112:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103698:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.103731:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787359983.103736:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989034a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+8:10345:x1874182595994112:12345-0@lo:104: Request processed in 46us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.103742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359983.103768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359983.103775:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:10345:x1874182595994240:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103782:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.103824:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787359983.103830:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+7:10345:x1874182595994240:12345-0@lo:104: Request processed in 56us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.103836:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359983.103849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787359983.103856:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:10345:x1874182595994368:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103863:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.103888:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787359983.103893:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:10345:x1874182595994368:12345-0@lo:104: Request processed in 38us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.103899:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787359983.103910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787359983.103916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:10345:x1874182595994496:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103923:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.103948:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787359983.103953:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:10345:x1874182595994496:12345-0@lo:104: Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.103958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787359983.103969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359983.103974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10345:x1874182595994624:12345-0@lo:104: 00010000:00010000:1.0:1787359983.103980:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.104013:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787359983.104018:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10345:x1874182595994624:12345-0@lo:104: Request processed in 44us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.104026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359983.104038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787359983.104044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10345:x1874182595994752:12345-0@lo:104: 00010000:00010000:1.0:1787359983.104050:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.104075:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787359983.104079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10345:x1874182595994752:12345-0@lo:104: Request processed in 37us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.104085:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787359983.104112:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787359983.104117:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.104124:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787359983.104128:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.104137:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104288:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787359983.104294:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104301:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104303:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104310:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104316:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104321:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104354:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104361:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104374:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696a00/0x359a4e2aee71fed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fedc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104393:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787359983.104396:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104413:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104415:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104422:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104428:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104433:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104447:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104452:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104464:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104470:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697200/0x359a4e2aee71feb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fec0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104479:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787359983.104482:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104487:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a00031800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104490:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104507:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104513:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104529:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104544:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104549:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104554:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104560:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a00031800/0x359a4e2aee71feab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104571:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787359983.104574:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104580:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104582:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104589:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104594:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104605:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104618:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104624:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104629:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104635:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71fe9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fea4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104644:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359983.104647:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104652:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104654:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104660:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104665:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104669:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104678:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104684:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104694:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697400/0x359a4e2aee71fe5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe65 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104709:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359983.104712:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104718:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787359983.104721:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104727:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359983.104733:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359983.104738:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359983.104750:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104756:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359983.104759:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104765:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681e00/0x359a4e2aee71fe34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe3b expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.104774:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359983.104782:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359983.104783:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359983.104799:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995264:0@lo:103: 00000100:00100000:0.0:1787359983.104833:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.104864:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995776:0@lo:103: 00000100:00100000:0.0:1787359983.104885:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.104903:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359983.104908:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995392:0@lo:103: 00000100:00100000:0.0:1787359983.104927:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.104950:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995264 00000100:00100000:0.0:1787359983.104955:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995264 00010000:00010000:0.0:1787359983.104975:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 22 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.104994:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995776 00000100:00100000:0.0:1787359983.104997:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995776 00010000:00010000:0.0:1787359983.105007:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.105017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995392 00000100:00100000:0.0:1787359983.105019:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995392 00010000:00010000:0.0:1787359983.105027:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 24 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.105039:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787359983.105044:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182595995264:12345-0@lo:103: 00010000:00010000:0.0:1787359983.105054:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359983.105059:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 24 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105078:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 24 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105094:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359983.105122:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182595995264:12345-0@lo:103: Request processed in 77us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.105129:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787359983.105143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359983.105149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3660:x1874182595995776:12345-0@lo:103: 00010000:00010000:0.0:1787359983.105156:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359983.105160:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105168:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 23 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105178:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359983.105199:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3660:x1874182595995776:12345-0@lo:103: Request processed in 50us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.105205:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359983.105217:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359983.105222:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3660:x1874182595995392:12345-0@lo:103: 10000000:00010000:1.0:1787359983.105332:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359983.105337:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359983.105358:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.105364:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359983.105370:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.105376:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee71fef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71feff expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.105391:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359983.105393:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359983.105395:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359983.105401:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359983.105773:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359983.105779:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 22 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105788:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 22 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.105805:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359983.105831:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3660:x1874182595995392:12345-0@lo:103: Request processed in 608us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.105837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359983.105865:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995136:0@lo:103: 00000100:00100000:0.0:1787359983.105891:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.105923:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995648:0@lo:103: 00000100:00100000:0.0:1787359983.105942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.106001:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359983.106008:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995520:0@lo:103: 00000100:00100000:0.0:1787359983.106030:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359983.108677:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993984:0@lo:104: 00000100:00100000:2.0:1787359983.108790:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994112:0@lo:104: 00010000:00010000:2.0:1787359983.108801:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06680a00/0x359a4e2aee71fec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71feb9 expref: 21 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.108816:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994240:0@lo:104: 00010000:00010000:2.0:1787359983.108891:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697e00/0x359a4e2aee71feb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71feab expref: 20 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.108902:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994368:0@lo:104: 00000100:00100000:2.0:1787359983.108912:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994496:0@lo:104: 00000100:00100000:2.0:1787359983.108919:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994624:0@lo:104: 00010000:00010000:2.0:1787359983.108929:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a00030600/0x359a4e2aee71fe3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fe34 expref: 19 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.108938:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595994752:0@lo:104: 00000100:00100000:2.0:1787359983.108951:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993472:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787359983.108959:0:10345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10345:1874182595993600:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787359983.109126:0:10345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.109404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359983.110861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995136 00000100:00100000:3.0:1787359983.110872:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995136 00010000:00010000:3.0:1787359983.110913:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 19 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.110940:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995648 00000100:00100000:3.0:1787359983.110942:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995648 00010000:00010000:3.0:1787359983.110954:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 20 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.110963:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995520 00000100:00100000:3.0:1787359983.110966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995520 00010000:00010000:3.0:1787359983.110974:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 21 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.110985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359983.110993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3659:x1874182595995136:12345-0@lo:103: 00010000:00010000:3.0:1787359983.111005:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359983.111010:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 21 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111020:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 21 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111035:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697a00/0x359a4e2aee71fedc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fed5 expref: 21 pid: 6524 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111067:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359983.111129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3659:x1874182595995136:12345-0@lo:103: Request processed in 136us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.111136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359983.111153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359983.111552:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3659:x1874182595995648:12345-0@lo:103: 00010000:00010000:3.0:1787359983.111561:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359983.111565:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 19 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111574:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 19 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111584:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a00031a00/0x359a4e2aee71fe65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fe5e expref: 19 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111595:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359983.111621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:3659:x1874182595995648:12345-0@lo:103: Request processed in 73us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.111627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359983.111640:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969472 00000100:00100000:3.0:1787359983.111643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969472 00010000:00010000:3.0:1787359983.111658:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 10 pid: 6526 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.111671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787359983.111677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:3659:x1874182595995520:12345-0@lo:103: 00010000:00010000:3.0:1787359983.111683:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359983.111694:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 17 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111702:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 17 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111712:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696000/0x359a4e2aee71fea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fe9d expref: 17 pid: 6526 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111720:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359983.111744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28ec1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3659:x1874182595995520:12345-0@lo:103: Request processed in 67us (5713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.111750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787359983.111785:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1787359983.111792:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574969472:12345-192.168.206.11@tcp:103: 00010000:00010000:3.0:1787359983.111799:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359983.111803:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 10 pid: 6526 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111813:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 10 pid: 6526 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111823:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ff61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee9c expref: 10 pid: 6526 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.111832:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359983.111869:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:2400:x1874182574969472:12345-192.168.206.11@tcp:103: Request processed in 77us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.111875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1787359983.112424:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595995904:0@lo:103: 00000100:00100000:3.0:1787359983.112469:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359983.112534:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595995904 00000100:00100000:3.0:1787359983.112539:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595995904 00010000:00010000:3.0:1787359983.112557:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 16 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.112576:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787359983.112584:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:3661:x1874182595995904:12345-0@lo:103: 00010000:00010000:3.0:1787359983.112592:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359983.112597:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 16 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.112606:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 16 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.112618:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a00030800/0x359a4e2aee71feff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fef8 expref: 16 pid: 6525 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.112630:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359983.112659:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:3661:x1874182595995904:12345-0@lo:103: Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.112666:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787359983.112701:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182595995904:0@lo:103: 00000100:00100000:2.0:1787359983.114146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359983.114350:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995392:0@lo:103: 00000100:00100000:2.0:1787359983.114363:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995264:0@lo:103: 00000100:00100000:2.0:1787359983.114372:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182595995776:0@lo:103: 00000100:00100000:2.0:1787359983.114408:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995520:0@lo:103: 00000100:00100000:2.0:1787359983.114495:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995136:0@lo:103: 00000100:00100000:2.0:1787359983.114505:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182595995648:0@lo:103: 00000100:00100000:0.0:1787359983.114647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969600 00000100:00100000:0.0:1787359983.114654:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969600 00010000:00010000:0.0:1787359983.114689:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359983.115400:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1787359983.115415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:2399:x1874182574969600:12345-192.168.206.11@tcp:103: 00010000:00010000:1.0:1787359983.115432:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359983.115439:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115452:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115468:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516600/0x359a4e2aee71ff5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eee95 expref: 9 pid: 6525 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115485:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115493:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115539:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115547:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115553:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115560:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115566:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787359983.115570:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115578:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115602:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.115613:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359983.115663:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+8:2399:x1874182574969600:12345-192.168.206.11@tcp:103: Request processed in 253us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.115671:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00010000:00010000:2.0:1787359983.116828:0:10345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.116841:0:10345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.116847:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041000/0x359a4e2aee71ffa0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.740117:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359983.865530:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595996032:0@lo:13: 00000100:00100000:3.0:1787359983.865603:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359983.865709:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996032 00000100:00100000:3.0:1787359983.865716:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996032 00000100:00100000:3.0:1787359983.865767:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787359983.865777:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595996032:12345-0@lo:13: 00002000:00000024:3.0:1787359983.865817:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359983.865863:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182595996032:12345-0@lo:13: Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.865870:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787359983.865908:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd6d80 x1874182595996032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359983.865925:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182595996032:0@lo:13: 00000100:00080000:2.0:1787359983.866112:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359983.866523:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595996160:0@lo:13: 00000100:00100000:0.0:1787359983.866561:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.866641:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996160 00000100:00100000:1.0:1787359983.866647:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996160 00000100:00100000:1.0:1787359983.866833:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359983.866842:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595996160:12345-0@lo:13: 00002000:00000024:1.0:1787359983.866864:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359983.866907:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182595996160:12345-0@lo:13: Request processed in 66us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.866914:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787359983.869543:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0a80 x1874182595996160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359983.869568:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182595996160:0@lo:13: 00000100:00080000:2.0:1787359983.871130:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359983.977772:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359983.977829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359983.977876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359983.977896:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969856 00000100:00100000:1.0:1787359983.977902:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359983.977906:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969856 00000100:00100000:1.0:1787359983.977927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359983.977946:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970112 00000100:00100000:1.0:1787359983.977950:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970112 00000100:00100000:2.0:1787359983.977960:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969984 00000100:00100000:2.0:1787359983.977963:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969984 00000100:00100000:1.0:1787359983.977978:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970240 00000100:00100000:1.0:1787359983.977980:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970240 00000100:00100000:2.0:1787359983.977984:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:1.0:1787359983.977998:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1787359983.978005:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574970112:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359983.978023:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574969856:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359983.978092:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574969856:12345-192.168.206.11@tcp:400: Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.978099:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787359983.978122:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:2.0:1787359983.978129:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574969984:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359983.978155:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574969984:12345-192.168.206.11@tcp:400: Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.978161:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00080000:2.0:1787359983.978329:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359983.978333:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359983.978335:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359983.978337:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359983.978361:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:2.0:1787359983.978369:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574970240:12345-192.168.206.11@tcp:400: 00000100:00100000:2.0:1787359983.978401:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574970240:12345-192.168.206.11@tcp:400: Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.978408:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1787359983.978529:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574969728 00000100:00100000:0.0:1787359983.978536:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574969728 00000100:00100000:0.0:1787359983.978572:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:0.0:1787359983.978579:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+8:2402:x1874182574969728:12345-192.168.206.11@tcp:400: 00000100:00100000:0.0:1787359983.978619:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+8:2402:x1874182574969728:12345-192.168.206.11@tcp:400: Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.978626:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:1.0:1787359983.978642:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574970112:12345-192.168.206.11@tcp:400: Request processed in 638us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.978649:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 10000000:01000000:2.0:1787359984.185372:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787359984.185379:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998902639800 from 48 10000000:01000000:2.0:1787359984.185385:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359984.185433:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.185445:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.185474:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.185497:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996288:0@lo:101: 00000100:00100000:2.0:1787359984.185577:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.185659:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.186361:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996288 00000100:00100000:0.0:1787359984.186370:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996288 00000100:00100000:0.0:1787359984.186424:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787359984.186434:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+15:6528:x1874182595996288:12345-0@lo:101: 00010000:00010000:0.0:1787359984.186448:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359984.186464:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681e00/0x359a4e2aee71ffae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffa7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.186487:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681e00/0x359a4e2aee71ffae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffa7 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.186498:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681e00/0x359a4e2aee71ffae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffa7 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.186507:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681e00, rc 0) 00000100:00100000:0.0:1787359984.186569:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996288:12345-0@lo:101: Request processed in 136us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.186576:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787359984.186621:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996288:0@lo:101: 00010000:00010000:2.0:1787359984.186638:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.186647:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.186719:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996416:0@lo:501: 00000100:00100000:2.0:1787359984.186748:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.186782:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24840 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.186842:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996416 00000100:00100000:3.0:1787359984.186847:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996416 00000100:00100000:3.0:1787359984.186879:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787359984.186886:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996416:12345-0@lo:501: 00000100:00100000:3.0:1787359984.187005:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996416:12345-0@lo:501: Request processed in 119us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.187012:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787359984.187135:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996416:0@lo:501: 00000100:00100000:2.0:1787359984.187171:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996544:0@lo:503: 00000100:00100000:2.0:1787359984.187423:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.187452:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24840 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.187505:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996544 00000100:00100000:3.0:1787359984.187511:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996544 00000100:00100000:3.0:1787359984.187543:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787359984.187549:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996544:12345-0@lo:503: 00000100:00100000:3.0:1787359984.187640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996544:12345-0@lo:503: Request processed in 89us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.187647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787359984.188427:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996544:0@lo:503: 00000100:00100000:2.0:1787359984.188994:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10362:1874182595996672:0@lo:502: 00000100:00100000:2.0:1787359984.189051:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.189091:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.189152:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996672 00000100:00100000:3.0:1787359984.189167:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996672 00000100:00100000:3.0:1787359984.189214:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787359984.189262:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:10362:x1874182595996672:12345-0@lo:502: 00000100:00100000:3.0:1787359984.189380:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:10362:x1874182595996672:12345-0@lo:502: Request processed in 156us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.189393:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787359984.189824:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10362:1874182595996672:0@lo:502: 00000100:00100000:2.0:1787359984.189872:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10362:1874182595996800:0@lo:502: 00000100:00100000:2.0:1787359984.189906:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.189938:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.189995:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996800 00000100:00100000:0.0:1787359984.190000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996800 00000100:00100000:0.0:1787359984.190037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787359984.190045:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:10362:x1874182595996800:12345-0@lo:502: 00000100:00100000:0.0:1787359984.190131:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:10362:x1874182595996800:12345-0@lo:502: Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.190138:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787359984.190572:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10362:1874182595996800:0@lo:502: 00000040:00080000:2.0:1787359984.190597:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787359984.191042:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787359984.191067:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359984.191077:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.191088:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359984.191096:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787359984.191099:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787359984.191102:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787359984.191130:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.191139:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.191148:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.191173:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996928:0@lo:101: 00000100:00100000:0.0:1787359984.191380:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.191415:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.191763:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595996928 00000100:00100000:3.0:1787359984.191771:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595996928 00000100:00100000:3.0:1787359984.191818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787359984.191828:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+16:6528:x1874182595996928:12345-0@lo:101: 00010000:00010000:3.0:1787359984.191840:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.191853:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350abe00/0x359a4e2aee71ffbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffb5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.191876:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350abe00/0x359a4e2aee71ffbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffb5 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.191887:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350abe00/0x359a4e2aee71ffbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffb5 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.191897:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350abe00, rc 0) 00000100:00100000:3.0:1787359984.191946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595996928:12345-0@lo:101: Request processed in 119us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.191951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787359984.194102:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595996928:0@lo:101: 00010000:00010000:0.0:1787359984.194129:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.194156:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.194523:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997056:0@lo:501: 00000100:00100000:0.0:1787359984.194577:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.194616:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.196686:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997056 00000100:00100000:3.0:1787359984.196701:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997056 00000100:00100000:3.0:1787359984.196805:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787359984.196816:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595997056:12345-0@lo:501: 00000100:00100000:3.0:1787359984.196980:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595997056:12345-0@lo:501: Request processed in 166us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.196988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787359984.197063:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997056:0@lo:501: 00000100:00100000:0.0:1787359984.197107:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997184:0@lo:503: 00000100:00100000:0.0:1787359984.197168:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.210031:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.213421:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997184 00000100:00100000:1.0:1787359984.213436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997184 00000100:00100000:1.0:1787359984.213501:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787359984.213522:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595997184:12345-0@lo:503: 00000100:00100000:1.0:1787359984.213693:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595997184:12345-0@lo:503: Request processed in 183us (16523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.213700:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787359984.216889:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997184:0@lo:503: 00000100:00100000:1.0:1787359984.219427:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10363:1874182595997312:0@lo:502: 00000100:00100000:1.0:1787359984.219530:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.219699:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997312 00000100:00100000:3.0:1787359984.219706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997312 00000100:00100000:3.0:1787359984.219762:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787359984.219772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:10363:x1874182595997312:12345-0@lo:502: 00000100:00100000:3.0:1787359984.230477:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:10363:x1874182595997312:12345-0@lo:502: Request processed in 10697us (10938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.230493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787359984.230861:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.230889:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10363:1874182595997312:0@lo:502: 00000020:01000000:1.0:1787359984.230924:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359984.230934:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359984.230936:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787359984.230942:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787359984.230978:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10363:1874182595997440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.231027:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359984.231098:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.234962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997440 00000100:00100000:2.0:1787359984.234977:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997440 00000100:00100000:2.0:1787359984.235044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787359984.235055:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:10363:x1874182595997440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.235963:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:10363:x1874182595997440:12345-0@lo:502:llog_process_th.0 Request processed in 907us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.235973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787359984.238920:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10363:1874182595997440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359984.238971:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359984.238981:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359984.238983:0:10363:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787359984.238987:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787359984.239189:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787359984.239222:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787359984.239267:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.239278:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359984.239288:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359984.239291:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a3d61e800 from 48 10000000:01000000:0.0:1787359984.239293:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359984.239327:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.239334:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.239343:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.239376:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.239434:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.239476:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.239600:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997568 00000100:00100000:3.0:1787359984.239607:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997568 00000100:00100000:3.0:1787359984.239648:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787359984.239670:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+17:6528:x1874182595997568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359984.239684:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.239697:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350aae00/0x359a4e2aee71ffca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffc3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.239720:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350aae00/0x359a4e2aee71ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffc3 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.239731:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350aae00/0x359a4e2aee71ffca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffc3 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.239740:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aae00, rc 0) 00000100:00100000:3.0:1787359984.239787:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595997568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.239793:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787359984.240440:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.240456:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.240464:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.240532:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.240572:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.240601:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.240754:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997696 00000100:00100000:3.0:1787359984.240762:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997696 00000100:00100000:3.0:1787359984.240802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787359984.240810:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595997696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.240929:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595997696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.240947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787359984.245465:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.245543:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.245637:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.245681:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.245904:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997824 00000100:00100000:2.0:1787359984.245912:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997824 00000100:00100000:2.0:1787359984.245968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787359984.245977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595997824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.246094:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595997824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.246102:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787359984.246187:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595997824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.246986:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10364:1874182595997952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.247039:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359984.247075:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.247183:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595997952 00000100:00100000:3.0:1787359984.247189:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595997952 00000100:00100000:3.0:1787359984.247394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787359984.247403:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:10364:x1874182595997952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.247506:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:10364:x1874182595997952:12345-0@lo:502:llog_process_th.0 Request processed in 104us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.247525:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787359984.247872:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10364:1874182595997952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.247918:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10364:1874182595998080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.247955:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.251843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998080 00000100:00100000:3.0:1787359984.251855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998080 00000100:00100000:3.0:1787359984.251903:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787359984.251914:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:10364:x1874182595998080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.252063:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:10364:x1874182595998080:12345-0@lo:502:llog_process_th.0 Request processed in 150us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.252070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787359984.253937:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.253980:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10364:1874182595998080:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787359984.254025:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787359984.254503:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787359984.254540:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787359984.254562:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.254574:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359984.254585:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787359984.254588:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787359984.254591:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787359984.254626:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.254645:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.254667:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.254690:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.254749:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.254785:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.254976:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998208 00000100:00100000:1.0:1787359984.254989:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998208 00000100:00100000:1.0:1787359984.255025:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787359984.255034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+18:6528:x1874182595998208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359984.255047:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359984.255058:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71200/0x359a4e2aee71ffd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffd1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.255079:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71200/0x359a4e2aee71ffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffd1 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.255089:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71200/0x359a4e2aee71ffd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffd1 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.255098:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71200, rc 0) 00000100:00100000:1.0:1787359984.255132:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.255139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787359984.255548:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359984.255574:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.255582:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.255634:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.255673:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.255694:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.255841:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998336 00000100:00100000:1.0:1787359984.255846:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998336 00000100:00100000:1.0:1787359984.255869:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787359984.255875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.255990:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.255997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787359984.256125:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.256152:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.256212:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.256507:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.256976:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998464 00000100:00100000:0.0:1787359984.256983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998464 00000100:00100000:1.0:1787359984.257037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787359984.257047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.257163:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.257177:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787359984.257567:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.258024:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10365:1874182595998592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.258075:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.258111:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.258588:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998592 00000100:00100000:2.0:1787359984.258595:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998592 00000100:00100000:2.0:1787359984.258642:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787359984.258652:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:10365:x1874182595998592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.258788:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:10365:x1874182595998592:12345-0@lo:502:llog_process_th.0 Request processed in 138us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.258805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787359984.258950:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10365:1874182595998592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359984.258976:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359984.258985:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359984.258987:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787359984.258993:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787359984.259018:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10365:1874182595998720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.259053:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.259083:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.263610:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998720 00000100:00100000:1.0:1787359984.263626:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998720 00000100:00100000:1.0:1787359984.263691:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787359984.263701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:10365:x1874182595998720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.263878:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:10365:x1874182595998720:12345-0@lo:502:llog_process_th.0 Request processed in 177us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.263886:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787359984.264126:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10365:1874182595998720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359984.264175:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359984.264183:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359984.264185:0:10365:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787359984.264190:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787359984.264995:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787359984.265017:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787359984.265028:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.265039:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359984.265049:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787359984.265051:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a10f4d000 from 48 10000000:01000000:2.0:1787359984.265054:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787359984.265085:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.265093:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.265101:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.265121:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.265484:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.265579:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998848 00000100:00100000:0.0:1787359984.265586:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998848 00000100:00100000:0.0:1787359984.265634:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787359984.265643:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:6528:x1874182595998848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.265654:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359984.265678:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ffe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffdf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.265714:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ffe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffdf expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.265724:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ffe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffdf expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.265733:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681a00, rc 0) 00000100:00100000:0.0:1787359984.265765:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595998848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.265772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787359984.267469:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.267508:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359984.267541:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.267552:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.267625:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.271653:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.272345:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.275441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595998976 00000100:00100000:0.0:1787359984.275456:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595998976 00000100:00100000:0.0:1787359984.275763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787359984.275776:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595998976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.275962:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595998976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.275970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787359984.276063:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595998976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.276114:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.276179:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.280689:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.283439:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999104 00000100:00100000:3.0:1787359984.283470:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999104 00000100:00100000:3.0:1787359984.283541:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787359984.283552:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595999104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.283741:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595999104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (7560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.283749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787359984.283928:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.286148:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10366:1874182595999232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.286272:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.286313:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.286673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999232 00000100:00100000:3.0:1787359984.286681:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999232 00000100:00100000:3.0:1787359984.286718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787359984.286726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:10366:x1874182595999232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.286857:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:10366:x1874182595999232:12345-0@lo:502:llog_process_th.0 Request processed in 131us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.286866:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787359984.287007:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10366:1874182595999232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.287051:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10366:1874182595999360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.287084:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.287113:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.287182:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999360 00000100:00100000:0.0:1787359984.287187:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999360 00000100:00100000:0.0:1787359984.287212:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787359984.287219:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:10366:x1874182595999360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.287317:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:10366:x1874182595999360:12345-0@lo:502:llog_process_th.0 Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.287324:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787359984.287491:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10366:1874182595999360:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787359984.287521:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787359984.287875:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787359984.287895:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359984.287911:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.287922:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359984.287931:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787359984.287934:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1787359984.287936:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787359984.287962:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.287971:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.287979:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.287994:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.288027:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.288059:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.288104:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999488 00000100:00100000:2.0:1787359984.288109:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999488 00000100:00100000:2.0:1787359984.288143:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787359984.288151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182595999488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359984.288170:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359984.288182:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041600/0x359a4e2aee71fff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71ffed expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.288203:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041600/0x359a4e2aee71fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71ffed expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.288212:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041600/0x359a4e2aee71fff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71ffed expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.288221:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041600, rc 0) 00000100:00100000:2.0:1787359984.288291:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595999488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.288304:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787359984.288489:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.288502:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.288521:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.288574:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.288611:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.288637:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.288816:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999616 00000100:00100000:2.0:1787359984.288822:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999616 00000100:00100000:2.0:1787359984.288843:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787359984.288850:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595999616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.288960:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595999616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.288967:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787359984.289109:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.289140:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.289189:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.289210:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eff9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.289562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999744 00000100:00100000:2.0:1787359984.289567:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999744 00000100:00100000:2.0:1787359984.289601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787359984.289607:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595999744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.289704:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182595999744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.289712:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787359984.289869:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182595999744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.291038:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10367:1874182595999872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.291095:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.291137:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.291258:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182595999872 00000100:00100000:0.0:1787359984.291265:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182595999872 00000100:00100000:0.0:1787359984.291298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787359984.291306:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10367:x1874182595999872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.291406:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10367:x1874182595999872:12345-0@lo:502:llog_process_th.0 Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.291413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787359984.291715:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10367:1874182595999872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359984.291743:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359984.291751:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359984.291754:0:10367:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787359984.291760:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787359984.291781:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10367:1874182596000000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.291816:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.291842:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.291975:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000000 00000100:00100000:0.0:1787359984.291980:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000000 00000100:00100000:0.0:1787359984.292012:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787359984.292019:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10367:x1874182596000000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.292101:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10367:x1874182596000000:12345-0@lo:502:llog_process_th.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.292108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787359984.292482:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10367:1874182596000000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359984.292507:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359984.292522:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359984.292524:0:10367:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787359984.292528:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1787359984.292741:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1787359984.292763:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787359984.292771:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.292793:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359984.292803:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359984.292807:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a0ffaa800 from 48 10000000:01000000:0.0:1787359984.292810:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359984.292834:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.292842:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.292851:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.292867:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.292899:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.292932:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.292981:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000128 00000100:00100000:2.0:1787359984.292987:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000128 00000100:00100000:2.0:1787359984.293022:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787359984.293030:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596000128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359984.293040:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359984.293054:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040c00/0x359a4e2aee720002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee71fffb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.293074:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040c00/0x359a4e2aee720002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee71fffb expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.293083:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040c00/0x359a4e2aee720002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fffb expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.293092:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040c00, rc 0) 00000100:00100000:2.0:1787359984.293130:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.293136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787359984.293494:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.293509:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.293529:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.293591:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.293621:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359984.293747:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000256 00000100:00100000:1.0:1787359984.293753:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000256 00000100:00100000:1.0:1787359984.293785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787359984.293793:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.293893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.293900:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787359984.293946:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae300 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.293960:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.293984:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.294021:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.294071:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.296292:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000384 00000100:00100000:3.0:1787359984.296306:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000384 00000100:00100000:3.0:1787359984.296375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787359984.296385:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.296574:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.296582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787359984.297316:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.300925:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10368:1874182596000512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359984.301011:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359984.301057:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.301113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000512 00000100:00100000:3.0:1787359984.301120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000512 00000100:00100000:3.0:1787359984.301559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787359984.301570:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10368:x1874182596000512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359984.301724:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10368:x1874182596000512:12345-0@lo:502:llog_process_th.0 Request processed in 155us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.301741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787359984.301827:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10368:1874182596000512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.301878:0:10368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10368:1874182596000640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.301916:0:10368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.307949:0:10368:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.309345:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000640 00000100:00100000:1.0:1787359984.309360:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000640 00000100:00100000:0.0:1787359984.309592:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787359984.309603:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10368:x1874182596000640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.309799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10368:x1874182596000640:12345-0@lo:502:llog_process_th.0 Request processed in 198us (7882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.309808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787359984.311570:0:10368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10368:1874182596000640:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787359984.311626:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787359984.312942:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787359984.312975:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359984.312986:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.312998:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359984.313008:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787359984.313011:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1787359984.313013:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359984.313050:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.313058:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.313086:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.313110:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.313190:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.313432:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.315402:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000768 00000100:00100000:3.0:1787359984.315425:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000768 00000100:00100000:3.0:1787359984.315543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787359984.315553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596000768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359984.315568:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.315584:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350ab600/0x359a4e2aee720010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720009 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.315610:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350ab600/0x359a4e2aee720010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720009 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.315620:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350ab600/0x359a4e2aee720010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720009 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.315629:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350ab600, rc 0) 00000100:00100000:3.0:1787359984.315702:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596000768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.315708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787359984.315951:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.315968:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.315978:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.316042:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.316076:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.319526:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.319919:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596000896 00000100:00100000:2.0:1787359984.319929:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596000896 00000100:00100000:2.0:1787359984.319983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787359984.319994:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596000896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.320401:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596000896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.320463:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.320536:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.320559:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.320702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596000896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 710us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.320710:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787359984.320735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001024 00000100:00100000:2.0:1787359984.320740:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001024 00000100:00100000:2.0:1787359984.320759:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787359984.320766:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596001024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.320850:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596001024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.320857:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787359984.321037:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359984.321819:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10369:1874182596001152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.321873:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.321906:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeaecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.321960:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001152 00000100:00100000:2.0:1787359984.321966:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001152 00000100:00100000:2.0:1787359984.322004:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787359984.322011:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10369:x1874182596001152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.322117:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10369:x1874182596001152:12345-0@lo:502:llog_process_th.0 Request processed in 105us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.322125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787359984.322312:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10369:1874182596001152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359984.322338:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359984.322346:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359984.322349:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787359984.322354:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787359984.322372:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10369:1874182596001280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359984.322405:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.322435:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeaecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.322554:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001280 00000100:00100000:2.0:1787359984.322559:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001280 00000100:00100000:2.0:1787359984.322578:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787359984.322583:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10369:x1874182596001280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359984.322652:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10369:x1874182596001280:12345-0@lo:502:llog_process_th.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.322734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787359984.322800:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10369:1874182596001280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359984.322817:0:10369:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359984.322821:0:10369:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359984.322823:0:10369:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787359984.322827:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787359984.322985:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787359984.323007:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787359984.323017:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.323028:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359984.323039:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787359984.323042:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a3bac8000 from 1 10000000:01000000:2.0:1787359984.323044:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787359984.323069:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.323077:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.323087:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.323102:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.323131:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359984.323328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001408 00000100:00100000:0.0:1787359984.323333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001408 00000100:00100000:0.0:1787359984.323353:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787359984.323360:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596001408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359984.323368:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359984.323379:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681000/0x359a4e2aee72001e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720017 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.323400:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681000/0x359a4e2aee72001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720017 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.323483:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681000/0x359a4e2aee72001e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720017 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.323493:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681000, rc 0) 00000100:00100000:0.0:1787359984.323531:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596001408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.323543:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787359984.323595:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24600 going to sleep for 11 seconds 00000100:00100000:2.0:1787359984.323611:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359984.323623:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.323640:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.324609:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359984.324651:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.324812:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24600 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.324936:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001536 00000100:00100000:3.0:1787359984.324943:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001536 00000100:00100000:3.0:1787359984.324978:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787359984.324985:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596001536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359984.325106:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596001536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (453us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787359984.325114:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787359984.331651:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596001536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787359984.331874:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787359984.331885:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.331895:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.743944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359984.744029:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970368 00000100:00100000:3.0:1787359984.744053:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970368 00000100:00100000:3.0:1787359984.744109:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:3.0:1787359984.744118:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+8:6174:x1874182574970368:12345-192.168.206.11@tcp:101: 00010000:00010000:3.0:1787359984.744133:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.744149:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350ab200/0x359a4e2aee720025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef0c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.744188:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350ab200/0x359a4e2aee720025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef0c expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.744200:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350ab200/0x359a4e2aee720025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef0c expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.744209:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350ab200, rc 0) 00000100:00100000:3.0:1787359984.744294:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574970368:12345-192.168.206.11@tcp:101: Request processed in 176us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.744301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:0.0:1787359984.746069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359984.746155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970496 00000100:00100000:2.0:1787359984.746174:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970496 00000100:00100000:2.0:1787359984.746222:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:2.0:1787359984.746260:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574970496:12345-192.168.206.11@tcp:501: 00000100:00100000:2.0:1787359984.746400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574970496:12345-192.168.206.11@tcp:501: Request processed in 143us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.746408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:2.0:1787359984.748529:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359984.748621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970624 00000100:00100000:1.0:1787359984.748630:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970624 00000100:00100000:1.0:1787359984.748751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:1.0:1787359984.748764:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574970624:12345-192.168.206.11@tcp:503: 00000100:00100000:1.0:1787359984.748967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574970624:12345-192.168.206.11@tcp:503: Request processed in 205us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.748975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:3.0:1787359984.759622:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359984.761010:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970752 00000100:00100000:1.0:1787359984.761024:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970752 00000100:00100000:1.0:1787359984.761092:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 247 00000100:00100000:1.0:1787359984.761103:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6654:x1874182574970752:12345-192.168.206.11@tcp:502: 00000100:00100000:1.0:1787359984.761297:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6654:x1874182574970752:12345-192.168.206.11@tcp:502: Request processed in 194us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.761307:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 247 00010000:00010000:3.0:1787359984.761370:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359984.766126:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359984.766356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574970880 00000100:00100000:2.0:1787359984.766366:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574970880 00000100:00100000:2.0:1787359984.766426:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:2.0:1787359984.766435:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6654:x1874182574970880:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787359984.766570:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6654:x1874182574970880:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 135us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.766579:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:1.0:1787359984.775363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359984.775587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971008 00000100:00100000:2.0:1787359984.775598:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971008 00000100:00100000:2.0:1787359984.775670:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:2.0:1787359984.775689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574971008:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359984.775707:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359984.775726:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041c00/0x359a4e2aee72002c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef13 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.775755:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041c00/0x359a4e2aee72002c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef13 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.775766:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041c00/0x359a4e2aee72002c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef13 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.775776:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041c00, rc 0) 00000100:00100000:2.0:1787359984.776002:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971008:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 322us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.776009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:3.0:1787359984.791446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359984.792033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971136 00000100:00100000:1.0:1787359984.792044:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971136 00000100:00100000:1.0:1787359984.792106:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:1.0:1787359984.792118:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971136:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359984.792286:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971136:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 170us (848us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359984.792295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 250 00010000:00010000:2.0:1787359985.785510:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359985.914606:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596001664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787359985.914714:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359985.914844:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001664 00000100:00100000:1.0:1787359985.914855:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001664 00000100:00100000:1.0:1787359985.914919:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787359985.914931:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596001664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787359985.914973:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787359985.915041:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596001664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359985.915063:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787359985.915116:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596001664:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1787359986.404952:0:10407:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0fe32580 20000000:00000080:1.0:1787359986.404975:0:10407:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9989039e3c00 uarg=0000000000000000 20000000:01000000:1.0:1787359986.405029:0:10407:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787359986.405037:0:10407:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787359986.405042:0:10407:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787359986.406089:0:10408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787359986.413439:0:10407:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787359986.421531:0:10407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787359986.421568:0:10407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787359986.421584:0:10407:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787359986.421601:0:10407:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787359986.421626:0:10407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421647:0:10407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421656:0:10407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421663:0:10407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421669:0:10407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421679:0:10407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421688:0:10407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421740:0:10407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421781:0:10407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 9 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.421801:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596001792:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787359986.421936:0:10407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.421945:0:10407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 23 pid: 6524 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.421955:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596001920:0@lo:104: 00000100:00100000:0.0:1787359986.422005:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359986.422056:0:10407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.422064:0:10407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 23 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.422073:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002048:0@lo:104: 00000100:00100000:0.0:1787359986.422101:0:10407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359986.422123:0:10407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.422129:0:10407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 23 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.422137:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002176:0@lo:104: 00010000:00010000:0.0:1787359986.422159:0:10407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.422176:0:10407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 23 pid: 6525 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.422184:0:10407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002304:0@lo:104: 00000100:00100000:0.0:1787359986.422207:0:10407:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359986.422335:0:6515:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787359986.422356:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.422369:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.422380:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596001920 00000100:00100000:3.0:1787359986.422390:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596001920 00000100:00100000:3.0:1787359986.422433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002048 00000100:00100000:3.0:1787359986.422436:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002048 00000100:00100000:2.0:1787359986.425866:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002176 00000100:00100000:2.0:1787359986.425884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002176 00000100:00100000:2.0:1787359986.425939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002304 00000100:00100000:2.0:1787359986.425943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002304 00000100:00100000:2.0:1787359986.425961:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359986.425972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:10407:x1874182596001920:12345-0@lo:104: 00010000:00010000:2.0:1787359986.425995:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.426131:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787359986.426138:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:10407:x1874182596001920:12345-0@lo:104: Request processed in 167us (4132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.426147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359986.426168:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787359986.426175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:10407:x1874182596002176:12345-0@lo:104: 00010000:00010000:2.0:1787359986.426184:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.426249:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596001920:0@lo:104: 00010000:00010000:2.0:1787359986.427345:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787359986.427360:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:10407:x1874182596002176:12345-0@lo:104: Request processed in 1183us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.427370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787359986.427401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787359986.427413:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10407:x1874182596002304:12345-0@lo:104: 00010000:00010000:2.0:1787359986.427428:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427496:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787359986.427513:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002176:0@lo:104: 00000100:00100000:2.0:1787359986.427515:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:10407:x1874182596002304:12345-0@lo:104: Request processed in 107us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.427522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359986.427524:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002304:0@lo:104: 00010000:00010000:2.0:1787359986.427541:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787359986.427548:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427556:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a00030400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359986.427560:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427569:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359986.427577:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359986.427583:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787359986.427633:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427641:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359986.427664:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427671:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a00030400/0x359a4e2aee71fe50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fe57 expref: -99 pid: 9526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427687:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787359986.427690:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427708:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359986.427711:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427717:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359986.427723:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359986.427728:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787359986.427743:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427749:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359986.427766:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427772:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696400/0x359a4e2aee71fcd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fcdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427782:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359986.427786:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427792:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787359986.427795:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427812:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359986.427818:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359986.427836:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787359986.427851:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427856:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359986.427862:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427869:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689c00/0x359a4e2aee71fcc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fccf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.427880:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359986.427882:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359986.427884:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359986.427903:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359986.427909:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359986.427927:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596002432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359986.427973:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359986.428028:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596002560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359986.428053:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359986.428374:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359986.428383:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596002688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359986.428418:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359986.428467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002432 00000100:00100000:2.0:1787359986.428475:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002432 00010000:00010000:2.0:1787359986.428516:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 24 pid: 6524 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.428516:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002560 00000100:00100000:1.0:1787359986.428520:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002560 00010000:00010000:1.0:1787359986.428538:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 25 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.428595:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002688 00000100:00100000:2.0:1787359986.428599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002688 00010000:00010000:2.0:1787359986.428613:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 26 pid: 6525 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.428951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359986.431916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787359986.431937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10407:x1874182596002048:12345-0@lo:104: 00010000:00010000:3.0:1787359986.431977:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.432064:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971264 00000100:00100000:1.0:1787359986.432076:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971264 00010000:00010000:1.0:1787359986.432107:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 10 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.432127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359986.432136:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+26:3661:x1874182596002432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.432310:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359986.432319:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 26 pid: 6524 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432343:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 26 pid: 6524 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432364:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681800/0x359a4e2aee71fe57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fe50 expref: 26 pid: 6524 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432385:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359986.432478:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+25:3661:x1874182596002432:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (4505us total) trans 0 rc 0/0 00010000:00010000:3.0:1787359986.432623:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359986.432630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:10407:x1874182596002048:12345-0@lo:104: Request processed in 702us (10529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.432639:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359986.432806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359986.432830:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359986.432838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596002560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.432848:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359986.432854:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 24 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432863:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 24 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432875:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517e00/0x359a4e2aee71fcdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fcd6 expref: 24 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432886:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359986.432918:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3658:x1874182596002560:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (4864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.432924:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359986.432939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787359986.432946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3658:x1874182596002688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.432961:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359986.432967:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 22 pid: 6525 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432975:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 22 pid: 6525 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.432985:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689000/0x359a4e2aee71fccf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fcc8 expref: 22 pid: 6525 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.433112:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359986.433139:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182596002688:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (4720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.433394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359986.433442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:3.0:1787359986.433453:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574971264:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359986.433463:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359986.433469:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 10 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.433481:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 10 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.433510:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359986.433561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28ec2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574971264:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 111us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.433570:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:3.0:1787359986.433642:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596002432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.433841:0:10407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516000/0x359a4e2aee71ff6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeed4 expref: 9 pid: 6525 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.433854:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596001792:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787359986.433868:0:10407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10407:1874182596002048:0@lo:104: 00010000:00010000:1.0:1787359986.433900:0:10407:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.434376:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596002688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359986.434387:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596002560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.434409:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359986.434417:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.434443:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787359986.434448:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.434456:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359986.434463:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359986.434469:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787359986.434584:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.434592:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359986.434615:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.434622:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696200/0x359a4e2aee71fd2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee71fd31 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.434639:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359986.434641:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359986.434643:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359986.434878:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596002816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359986.434937:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359986.435153:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002816 00000100:00100000:1.0:1787359986.435161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002816 00010000:00010000:1.0:1787359986.435192:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 21 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.435263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359986.435283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182596002816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.435297:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359986.435303:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 21 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435315:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 21 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435330:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689600/0x359a4e2aee71fd31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee71fd2a expref: 21 pid: 6526 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435347:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435357:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435375:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435382:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435390:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435397:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435403:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787359986.435409:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435423:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435440:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435450:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359986.435488:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3660:x1874182596002816:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.435497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1787359986.435541:0:10407:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435550:0:10407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.435558:0:10407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee720033 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.436939:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596002816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787359986.812631:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359986.938801:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596002944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787359986.938891:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359986.938999:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596002944 00000100:00100000:2.0:1787359986.939009:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596002944 00000100:00100000:2.0:1787359986.939073:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787359986.939084:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596002944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359986.939120:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359986.939481:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596003072:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939546:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939572:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596003584:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939596:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939615:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596004096:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939649:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939670:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787359986.939675:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596003200:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939713:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939730:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596003712:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939749:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939764:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596004224:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939784:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.939836:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003072 00000100:00100000:3.0:1787359986.939841:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003072 00000100:00100000:3.0:1787359986.939875:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787359986.939882:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3658:x1874182596003072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.939919:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3658:x1874182596003072:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.939928:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1787359986.939968:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359986.939983:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596003328:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940286:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940308:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596003840:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940330:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940348:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596004352:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940369:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940382:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787359986.940387:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596003456:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940408:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940429:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596003968:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940453:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940470:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596004480:0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359986.940605:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003584 00000100:00100000:3.0:1787359986.940610:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003584 00000100:00100000:3.0:1787359986.940639:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003328 00000100:00100000:3.0:1787359986.940642:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003328 00000100:00100000:3.0:1787359986.940656:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787359986.940664:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596003584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940716:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596003584:12345-0@lo:400:kworker.0 Request processed in 52us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.940722:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787359986.940735:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787359986.940740:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596003328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940773:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596003328:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.940779:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787359986.940798:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004096 00000100:00100000:3.0:1787359986.940801:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004096 00000100:00100000:3.0:1787359986.940832:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003968 00000100:00100000:3.0:1787359986.940835:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003968 00000100:00100000:3.0:1787359986.940847:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004480 00000100:00100000:3.0:1787359986.940850:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004480 00000100:00100000:3.0:1787359986.940865:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787359986.940871:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596004096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940904:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596004096:12345-0@lo:400:kworker.0 Request processed in 33us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.940921:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787359986.940933:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787359986.940938:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.940966:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596003968:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.940971:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787359986.940982:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787359986.941126:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596002944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2043us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941135:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787359986.941196:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003200 00000100:00100000:2.0:1787359986.941200:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003200 00000100:00100000:2.0:1787359986.941238:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003712 00000100:00100000:2.0:1787359986.941248:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003712 00000100:00100000:2.0:1787359986.941270:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004224 00000100:00100000:2.0:1787359986.941273:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004224 00000100:00100000:2.0:1787359986.941288:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003840 00000100:00100000:2.0:1787359986.941291:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003840 00000100:00100000:2.0:1787359986.941303:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004352 00000100:00100000:2.0:1787359986.941305:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004352 00000100:00100000:2.0:1787359986.941320:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596003456 00000100:00100000:2.0:1787359986.941322:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596003456 00000100:00100000:2.0:1787359986.941338:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787359986.941344:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596003200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941376:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596003200:12345-0@lo:400:kworker.0 Request processed in 32us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787359986.941394:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787359986.941400:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596003712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941422:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596003712:12345-0@lo:400:kworker.0 Request processed in 23us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941427:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787359986.941438:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787359986.941443:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941468:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596004224:12345-0@lo:400:kworker.0 Request processed in 25us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941473:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787359986.941510:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359986.941517:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596003840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941544:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596003840:12345-0@lo:400:kworker.0 Request processed in 29us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941559:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359986.941572:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787359986.941578:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596004352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941606:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596004352:12345-0@lo:400:kworker.0 Request processed in 28us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941611:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787359986.941623:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787359986.941628:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596003456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941652:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596003456:12345-0@lo:400:kworker.0 Request processed in 25us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.941658:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1787359986.941750:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5880 x1874182596002944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.941774:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596002944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787359986.941813:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596003200:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941826:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596003712:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941837:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596004224:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941847:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596003072:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.941859:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596003584:0@lo:400:kworker.0 00010000:00080000:2.0:1787359986.941871:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eddf480 x1874182596004096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.941881:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596004096:0@lo:400:kworker.0 00000100:00080000:2.0:1787359986.941925:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787359986.941929:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359986.941932:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359986.941934:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359986.941952:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596003456:0@lo:400:kworker.0 00010000:00080000:2.0:1787359986.941966:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edde300 x1874182596003968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.941974:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596003968:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.942001:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596003328:0@lo:400:kworker.0 00010000:00080000:2.0:1787359986.942013:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a0fc31880 x1874182596003840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.942021:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596003840:0@lo:400:kworker.0 00010000:00080000:2.0:1787359986.942030:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510ce00 x1874182596004352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.942037:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596004352:0@lo:400:kworker.0 00000100:00100000:2.0:1787359986.942130:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596004608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787359986.942169:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359986.942217:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004608 00000100:00100000:2.0:1787359986.942251:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004608 00000100:00100000:2.0:1787359986.942283:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787359986.942291:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874182596004608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787359986.942309:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359986.942349:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3658:x1874182596004608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.942363:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787359986.942390:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5880 x1874182596004608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.942403:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596004608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787359986.943338:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596004480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359986.943426:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596004480:12345-0@lo:400:kworker.0 Request processed in 2438us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.943436:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787359986.945882:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510ca80 x1874182596004480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359986.945906:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596004480:0@lo:400:kworker.0 00010000:00010000:3.0:1787359987.833370:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359987.892043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359987.892117:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971392 00000100:00100000:0.0:1787359987.892130:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971392 00000100:00100000:0.0:1787359987.892202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:0.0:1787359987.892216:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:6174:x1874182574971392:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359987.892260:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359987.892288:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef1a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.892327:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.892341:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.892353:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:0.0:1787359987.892417:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971392:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 205us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.892424:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:2.0:1787359987.897752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359987.901877:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971520 00000100:00100000:0.0:1787359987.901899:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971520 00000100:00100000:0.0:1787359987.901981:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:0.0:1787359987.902004:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971520:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359987.902214:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971520:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 211us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.902241:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:1.0:1787359987.913299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359987.913506:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971648 00000100:00100000:3.0:1787359987.913520:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971648 00000100:00100000:3.0:1787359987.913618:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:3.0:1787359987.913630:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971648:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359987.913914:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6174:x1874182574971648:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 284us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.913924:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:0.0:1787359987.918408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359987.918512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971776 00000100:00100000:1.0:1787359987.918525:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971776 00000100:00100000:1.0:1787359987.918596:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00100000:1.0:1787359987.918609:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6717:x1874182574971776:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787359987.918809:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6717:x1874182574971776:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.918819:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00100000:1.0:1787359987.931433:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787359987.934190:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574971904 00000100:00100000:0.0:1787359987.934212:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574971904 00000100:00100000:0.0:1787359987.934466:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00100000:0.0:1787359987.934481:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6717:x1874182574971904:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787359987.934702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:6717:x1874182574971904:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 225us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.934712:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00100000:1.0:1787359987.980117:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596004736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787359987.980208:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359987.980316:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004736 00000100:00100000:1.0:1787359987.980325:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004736 00000100:00100000:1.0:1787359987.980380:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787359987.980390:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596004736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787359987.980431:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787359987.980482:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596004736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.980490:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787359987.980557:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596004736:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1787359988.091375:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787359988.091386:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998902639800 from 4 10000000:01000000:3.0:1787359988.091394:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787359988.091469:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359988.091483:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359988.091526:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359988.091558:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596004864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.091675:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.091740:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.091878:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004864 00000100:00100000:0.0:1787359988.091888:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004864 00000100:00100000:0.0:1787359988.091956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787359988.091967:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182596004864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359988.099597:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359988.099643:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720041 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.099700:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720041 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.099714:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720041 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.099727:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517e00, rc 0) 00000100:00100000:0.0:1787359988.099883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596004864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7915us (8206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.099893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787359988.099998:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596004864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359988.100021:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359988.100032:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359988.100137:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596004992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.100180:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359988.100269:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359988.100271:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596004992 00000100:00100000:3.0:1787359988.100279:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596004992 00000100:00100000:3.0:1787359988.100334:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787359988.100345:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596004992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.100485:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596004992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.100503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787359988.100747:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596004992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.100781:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.100825:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359988.100859:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359988.101053:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005120 00000100:00100000:3.0:1787359988.101059:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005120 00000100:00100000:3.0:1787359988.101090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787359988.101097:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596005120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.101197:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596005120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.101204:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787359988.101760:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.102593:0:10475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10475:1874182596005248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359988.103059:0:10475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.103164:0:10475:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.106453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005248 00000100:00100000:1.0:1787359988.106475:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005248 00000100:00100000:1.0:1787359988.106696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787359988.106712:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10475:x1874182596005248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359988.106978:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10475:x1874182596005248:12345-0@lo:502:llog_process_th.0 Request processed in 268us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.106988:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787359988.107125:0:10475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10475:1874182596005248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359988.107173:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359988.107193:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359988.107196:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787359988.109540:0:10475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998902639800 00000020:00000080:1.0:1787359988.113537:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787359988.113700:0:10475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10475:1874182596005376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359988.113823:0:10475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359988.113870:0:10475:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.113959:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005376 00000100:00100000:0.0:1787359988.113969:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005376 00000100:00100000:0.0:1787359988.114037:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787359988.114047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10475:x1874182596005376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.114189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:10475:x1874182596005376:12345-0@lo:502:llog_process_th.0 Request processed in 142us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.114197:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787359988.114517:0:10475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10475:1874182596005376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359988.114555:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359988.114563:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359988.114565:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787359988.114570:0:10475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787359988.117474:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787359988.117547:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359988.117562:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.117578:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359988.117591:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359988.117594:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61e800 from 4 10000000:01000000:0.0:1787359988.117597:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359988.117646:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.117668:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.117682:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359988.117714:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.117797:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.117858:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359988.126303:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005504 00000100:00100000:2.0:1787359988.126325:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005504 00000100:00100000:2.0:1787359988.126410:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787359988.126423:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596005504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359988.126446:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359988.126468:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72004f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.126516:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72004f expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.126528:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72004f expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.126539:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040000, rc 0) 00000100:00100000:2.0:1787359988.126647:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596005504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (8850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359988.126654:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787359988.129437:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359988.129474:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.129490:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359988.129626:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.129708:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.129777:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359988.129799:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005632 00000100:00100000:3.0:1787359988.129807:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005632 00000100:00100000:3.0:1787359988.129897:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787359988.129909:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596005632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.130079:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596005632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.130088:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787359988.130327:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.130371:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.130419:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.130449:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.130544:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005760 00000100:00100000:0.0:1787359988.130549:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005760 00000100:00100000:0.0:1787359988.130578:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787359988.130585:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596005760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.130691:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596005760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.130698:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787359988.130821:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596005760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.131570:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10477:1874182596005888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359988.131630:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.131669:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.132001:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596005888 00000100:00100000:0.0:1787359988.132008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596005888 00000100:00100000:0.0:1787359988.132060:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787359988.132071:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10477:x1874182596005888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.132222:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10477:x1874182596005888:12345-0@lo:502:llog_process_th.0 Request processed in 153us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.132255:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787359988.132439:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10477:1874182596005888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359988.132477:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359988.132489:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359988.132502:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787359988.132511:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3d61e800 00000020:00000080:2.0:1787359988.132514:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787359988.132602:0:10477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10477:1874182596006016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359988.132642:0:10477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.132677:0:10477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787359988.133429:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006016 00000100:00100000:3.0:1787359988.133440:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006016 00000100:00100000:3.0:1787359988.133486:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787359988.133508:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10477:x1874182596006016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359988.133640:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:10477:x1874182596006016:12345-0@lo:502:llog_process_th.0 Request processed in 133us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.133648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787359988.133665:0:10477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10477:1874182596006016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359988.133694:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359988.133701:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359988.133703:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787359988.133796:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359988.134382:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359988.134409:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359988.134422:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.134435:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359988.134459:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359988.134462:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a10f4d000 from 4 10000000:01000000:2.0:1787359988.134465:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359988.134510:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.134518:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.134528:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359988.134550:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.134596:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.134643:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.135043:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006144 00000100:00100000:0.0:1787359988.135051:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006144 00000100:00100000:0.0:1787359988.135105:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787359988.135115:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596006144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359988.135129:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359988.136325:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72005d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.136372:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72005d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.136385:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72005d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.136397:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:0.0:1787359988.136510:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1395us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.136520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787359988.137281:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359988.137310:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359988.137324:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359988.137425:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359988.137477:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.137532:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.137677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006272 00000100:00100000:1.0:1787359988.137685:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006272 00000100:00100000:1.0:1787359988.137740:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787359988.137752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.137904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.137913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787359988.139088:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.141105:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.141253:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.141313:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.141540:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006400 00000100:00100000:1.0:1787359988.141551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006400 00000100:00100000:1.0:1787359988.141611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787359988.141630:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.141788:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.141797:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787359988.142148:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.145611:0:10479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10479:1874182596006528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359988.145733:0:10479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359988.145795:0:10479:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a10f06900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.145845:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006528 00000100:00100000:0.0:1787359988.145854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006528 00000100:00100000:0.0:1787359988.145915:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787359988.145927:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10479:x1874182596006528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.146087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10479:x1874182596006528:12345-0@lo:502:llog_process_th.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.146096:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787359988.146437:0:10479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10479:1874182596006528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359988.146476:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359988.146488:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359988.146490:0:10479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787359988.146511:0:10479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a10f4d000 00000020:00000080:2.0:1787359988.146513:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787359988.146608:0:10479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10479:1874182596006656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359988.146652:0:10479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.146692:0:10479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.146947:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006656 00000100:00100000:0.0:1787359988.146953:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006656 00000100:00100000:0.0:1787359988.146995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787359988.147004:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10479:x1874182596006656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.147101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:10479:x1874182596006656:12345-0@lo:502:llog_process_th.0 Request processed in 98us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.147108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787359988.147971:0:10479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10479:1874182596006656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359988.148026:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359988.148035:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359988.148038:0:10479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787359988.148044:0:10479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359988.149010:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359988.149045:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359988.149059:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.149072:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359988.149084:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359988.149087:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a0ffaa800 from 4 10000000:01000000:2.0:1787359988.149091:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359988.149132:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.150885:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.150904:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359988.150940:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.151034:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.151087:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787359988.153540:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006784 00000100:00100000:0.0:1787359988.153561:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006784 00000100:00100000:0.0:1787359988.153637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787359988.153650:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596006784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359988.153670:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359988.153693:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72006b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.153734:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72006b expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.153769:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72006b expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.153780:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:0.0:1787359988.153875:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596006784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.153883:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787359988.155490:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359988.155543:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.155564:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359988.155677:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.155760:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.155810:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.157025:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596006912 00000100:00100000:1.0:1787359988.157039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596006912 00000100:00100000:1.0:1787359988.157115:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787359988.157127:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596006912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.157340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596006912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.157349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787359988.157551:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596006912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.157607:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596007040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359988.157676:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359988.157720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007040 00000100:00100000:1.0:1787359988.157726:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007040 00000100:00100000:1.0:1787359988.157755:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787359988.157763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596007040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359988.157846:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596007040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.157852:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787359988.157985:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787359988.158000:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596007040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359988.158422:0:10480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10480:1874182596007168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.158468:0:10480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.158507:0:10480:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.158522:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007168 00000100:00100000:1.0:1787359988.158527:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007168 00000100:00100000:1.0:1787359988.158565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787359988.158572:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:10480:x1874182596007168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359988.158679:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:10480:x1874182596007168:12345-0@lo:502:llog_process_th.0 Request processed in 106us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.158693:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787359988.158735:0:10480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10480:1874182596007168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359988.158763:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359988.158774:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359988.158777:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787359988.158790:0:10480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a0ffaa800 00000020:00000080:0.0:1787359988.158793:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787359988.159022:0:10480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10480:1874182596007296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359988.159057:0:10480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.159079:0:10480:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a24e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359988.159130:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007296 00000100:00100000:2.0:1787359988.159135:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007296 00000100:00100000:2.0:1787359988.159179:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787359988.159187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:10480:x1874182596007296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359988.159304:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:10480:x1874182596007296:12345-0@lo:502:llog_process_th.0 Request processed in 117us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359988.159311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787359988.159476:0:10480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:10480:1874182596007296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359988.159506:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359988.159511:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359988.159513:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787359988.159518:0:10480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359988.159951:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359988.159981:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359988.159992:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.160004:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359988.859893:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359988.986862:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359988.986892:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596007424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787359988.987008:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.987090:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007424 00000100:00100000:0.0:1787359988.987099:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007424 00000100:00100000:0.0:1787359988.987171:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359988.987183:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596007424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359988.987222:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359988.987307:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596007424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.987315:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787359988.987341:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359988.987587:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359988.987608:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596007552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787359988.987644:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.987669:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007552 00000100:00100000:3.0:1787359988.987674:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007552 00010000:00080000:0.0:1787359988.988545:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3c700 x1874182596007424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359988.988572:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596007424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359988.993629:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787359988.993653:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596007552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787359988.993688:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359988.993794:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596007552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.993802:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787359988.993871:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510e300 x1874182596007552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359988.993895:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596007552:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787359988.994117:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359989.101814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359989.101869:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359989.101904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359989.101925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359989.102037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359989.102095:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972288 00000100:00100000:1.0:1787359989.102110:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972288 00000100:00100000:1.0:1787359989.102195:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972160 00000100:00100000:1.0:1787359989.102199:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972160 00000100:00100000:1.0:1787359989.102273:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:1.0:1787359989.102285:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972288:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787359989.102394:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972288:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 111us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359989.102403:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:1.0:1787359989.102426:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:1.0:1787359989.102433:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574972160:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787359989.102461:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574972160:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359989.102467:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:1.0:1787359989.102501:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972544 00000100:00100000:1.0:1787359989.102506:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972544 00000100:00100000:1.0:1787359989.102540:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972416 00000100:00100000:1.0:1787359989.102543:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972416 00000100:00100000:1.0:1787359989.102565:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787359989.102572:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972544:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787359989.102618:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972544:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 47us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359989.102626:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787359989.102637:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:1.0:1787359989.102643:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972416:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787359989.102665:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574972416:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359989.102672:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00080000:1.0:1787359989.102698:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359989.102703:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359989.102707:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359989.102709:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787359989.103039:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972032 00000100:00100000:3.0:1787359989.103045:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972032 00000100:00100000:3.0:1787359989.103087:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 277 00000100:00100000:3.0:1787359989.103095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574972032:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787359989.103135:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574972032:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359989.103142:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 277 00010000:00010000:2.0:1787359989.881956:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359990.905687:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359991.033433:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359991.033456:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596007680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787359991.033533:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359991.035025:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007680 00000100:00100000:1.0:1787359991.035037:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007680 00000100:00100000:1.0:1787359991.035103:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359991.035114:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596007680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787359991.035149:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787359991.035222:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596007680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359991.035252:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359991.035303:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596007680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787359991.933685:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359992.057549:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359992.057570:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596008192:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.057610:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596008320:0@lo:400:kworker.0 00000100:00100000:3.0:1787359992.057632:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.057652:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359992.057676:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596007808:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.057676:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596008832:0@lo:400:kworker.0 00000100:00100000:3.0:1787359992.057710:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359992.057874:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008192 00000100:00100000:2.0:1787359992.057881:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008192 00000100:00100000:2.0:1787359992.057930:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787359992.057940:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596008192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.058545:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.058578:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596009344:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.058606:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.058631:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787359992.058831:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596008704:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.058857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.058883:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596009216:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.058906:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.058933:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596008064:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.058958:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.058975:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596008576:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.059013:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.059035:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596009088:0@lo:400:kworker.0 00000100:00100000:0.0:1787359992.059241:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008832 00000100:00100000:0.0:1787359992.059247:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008832 00000100:00100000:3.0:1787359992.059280:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007808 00000100:00100000:0.0:1787359992.059282:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009344 00000100:00100000:3.0:1787359992.059284:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007808 00000100:00100000:0.0:1787359992.059284:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009344 00000100:00100000:0.0:1787359992.059295:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008704 00000100:00100000:0.0:1787359992.059297:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008704 00000100:00100000:0.0:1787359992.059307:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009216 00000100:00100000:3.0:1787359992.059309:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787359992.059309:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009216 00000100:00100000:3.0:1787359992.059316:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596007808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359992.059320:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787359992.059325:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596008832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359992.059358:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596007808:12345-0@lo:400:kworker.0 Request processed in 41us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359992.059358:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596008832:12345-0@lo:400:kworker.0 Request processed in 31us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359992.059365:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787359992.059369:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787359992.059380:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359992.059386:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596009344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359992.059412:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596009344:12345-0@lo:400:kworker.0 Request processed in 27us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359992.059417:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359992.059425:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787359992.059431:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596008704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359992.059452:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596007808:0@lo:400:kworker.0 00000100:00100000:0.0:1787359992.059452:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596008704:12345-0@lo:400:kworker.0 Request processed in 22us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359992.059458:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787359992.059467:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359992.059485:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359992.059511:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35368450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596009216:12345-0@lo:400:kworker.0 Request processed in 40us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359992.059516:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787359992.059701:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359992.059706:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787359992.059729:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec74700 x1874182596008704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359992.059741:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596008704:0@lo:400:kworker.0 00010000:00080000:0.0:1787359992.059752:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec74a80 x1874182596009216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359992.059760:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596009216:0@lo:400:kworker.0 00010000:00080000:0.0:1787359992.059781:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec74000 x1874182596008832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359992.059789:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596008832:0@lo:400:kworker.0 00010000:00080000:0.0:1787359992.059798:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec77b80 x1874182596009344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359992.059806:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596009344:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.059898:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.059927:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596009600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359992.059951:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.059975:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787359992.059982:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596007936:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060003:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.060014:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596008448:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060033:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.060042:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596008960:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060126:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.060144:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596009472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787359992.060174:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359992.060205:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008320 00000100:00100000:1.0:1787359992.060210:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008320 00000100:00100000:1.0:1787359992.060252:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008064 00000100:00100000:1.0:1787359992.060256:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008064 00000100:00100000:1.0:1787359992.060271:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359992.060277:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596008320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060313:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596008320:12345-0@lo:400:kworker.0 Request processed in 36us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.060320:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359992.060332:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359992.060338:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596008064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060366:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596008064:12345-0@lo:400:kworker.0 Request processed in 28us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.060372:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359992.060416:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008576 00000100:00100000:1.0:1787359992.060419:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008576 00000100:00100000:1.0:1787359992.060439:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009088 00000100:00100000:1.0:1787359992.060441:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009088 00000100:00100000:1.0:1787359992.060452:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596007936 00000100:00100000:1.0:1787359992.060454:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596007936 00000100:00100000:1.0:1787359992.060462:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008448 00000100:00100000:1.0:1787359992.060464:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008448 00000100:00100000:1.0:1787359992.060489:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596008960 00000100:00100000:1.0:1787359992.060492:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596008960 00000100:00100000:1.0:1787359992.060506:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787359992.060513:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596008576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060542:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596008576:12345-0@lo:400:kworker.0 Request processed in 30us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.060559:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787359992.060571:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787359992.060577:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596009088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.060605:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596009088:12345-0@lo:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.060610:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787359992.060621:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787359992.060626:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596007936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.062206:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596007936:12345-0@lo:400:kworker.0 Request processed in 1571us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.062218:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787359992.062259:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787359992.062269:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596008448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.062303:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596008448:12345-0@lo:400:kworker.0 Request processed in 37us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.062309:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787359992.062320:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787359992.062325:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.062351:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596008960:12345-0@lo:400:kworker.0 Request processed in 26us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.062357:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787359992.062379:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009600 00000100:00100000:1.0:1787359992.062386:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009600 00000100:00100000:1.0:1787359992.062408:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009472 00000100:00100000:1.0:1787359992.062411:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009472 00000100:00100000:1.0:1787359992.062431:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787359992.062437:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596009600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359992.062456:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359992.062501:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596009600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.062506:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787359992.062518:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359992.062524:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596009472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787359992.062532:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359992.062555:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596009472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (2381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359992.062561:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359992.062602:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596007936:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.062614:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596008448:0@lo:400:kworker.0 00000100:00100000:1.0:1787359992.062623:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596008960:0@lo:400:kworker.0 00000100:00080000:0.0:1787359992.062764:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359992.062769:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787359992.062793:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596008320:0@lo:400:kworker.0 00010000:00080000:1.0:1787359992.067733:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd7800 x1874182596009472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359992.067774:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596009472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787359992.067810:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596008064:0@lo:400:kworker.0 00010000:00080000:1.0:1787359992.067824:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea2a00 x1874182596008576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359992.067833:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596008576:0@lo:400:kworker.0 00010000:00080000:1.0:1787359992.067844:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec77800 x1874182596009088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359992.067864:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596009088:0@lo:400:kworker.0 00010000:00080000:1.0:1787359992.067878:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd4a80 x1874182596009600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359992.067889:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596009600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787359992.068547:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596008192:12345-0@lo:400:kworker.0 Request processed in 10605us (10910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359992.068558:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787359992.068720:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596008192:0@lo:400:kworker.0 00010000:00010000:2.0:1787359992.957302:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359993.088639:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359993.088660:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596009728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787359993.088725:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359993.088793:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009728 00000100:00100000:0.0:1787359993.088800:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009728 00000100:00100000:0.0:1787359993.088844:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787359993.088853:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596009728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787359993.088884:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787359993.088927:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596009728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359993.088934:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787359993.088978:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596009728:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787359993.516348:0:10707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787359993.977710:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359994.105493:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359994.105515:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596009856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359994.105580:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359994.105805:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009856 00000100:00100000:0.0:1787359994.105814:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009856 00000100:00100000:0.0:1787359994.105889:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359994.105899:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596009856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359994.105926:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359994.105984:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596009856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359994.105991:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787359994.106031:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f480 x1874182596009856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359994.106048:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596009856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359994.106297:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359994.106632:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359994.106652:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596009984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787359994.106686:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359994.107610:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596009984 00000100:00100000:0.0:1787359994.107619:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596009984 00000100:00100000:0.0:1787359994.107684:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787359994.107693:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596009984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787359994.107713:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787359994.107768:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596009984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359994.107774:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787359994.107813:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5500 x1874182596009984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359994.107831:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596009984:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787359994.108396:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359994.219691:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359994.219736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359994.219764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359994.219794:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359994.219815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787359994.219843:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973056 00000100:00100000:2.0:1787359994.219852:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973056 00000100:00100000:2.0:1787359994.219905:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973184 00000100:00100000:2.0:1787359994.219916:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973184 00000100:00100000:2.0:1787359994.219944:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787359994.219968:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973056:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787359994.220033:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973056:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359994.220041:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787359994.220057:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:2.0:1787359994.220064:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973184:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787359994.220087:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973184:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359994.220093:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00080000:2.0:1787359994.220121:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359994.220125:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359994.220277:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972672 00000100:00100000:2.0:1787359994.220282:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972672 00000100:00100000:2.0:1787359994.220307:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:2.0:1787359994.220315:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574972672:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787359994.220344:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574972672:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359994.220351:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:3.0:1787359994.221667:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972800 00000100:00100000:3.0:1787359994.221678:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972800 00000100:00100000:3.0:1787359994.221744:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574972928 00000100:00100000:3.0:1787359994.221748:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574972928 00000100:00100000:3.0:1787359994.221773:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1787359994.221780:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574972800:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787359994.221834:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574972800:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 53us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359994.221840:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1787359994.221856:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:3.0:1787359994.221863:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574972928:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787359994.221887:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574972928:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359994.221892:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00080000:3.0:1787359994.222030:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787359994.222044:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787359995.001504:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359996.026956:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359996.161429:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359996.161461:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596010112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787359996.161529:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359996.161598:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010112 00000100:00100000:2.0:1787359996.161605:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010112 00000100:00100000:2.0:1787359996.161648:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359996.161664:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596010112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787359996.161698:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787359996.161743:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596010112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359996.161749:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359996.161797:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596010112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787359997.058597:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359997.178619:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596010240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359997.178688:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178733:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596010752:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178758:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178789:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596011264:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178813:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178830:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596011776:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178849:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178872:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787359997.178878:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596010368:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178905:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178924:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596010880:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178943:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178957:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596011392:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.178974:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.178987:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596011904:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179016:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179044:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596010496:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179083:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596011008:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179099:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179112:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596011520:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179129:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179144:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787359997.179149:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596010624:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179166:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179181:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596011136:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179197:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179206:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596011648:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179219:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359997.179266:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010240 00000100:00100000:1.0:1787359997.179273:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010240 00000100:00100000:1.0:1787359997.179323:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359997.179332:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596010240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359997.179360:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787359997.179402:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596010240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179409:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787359997.179432:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010752 00000100:00100000:1.0:1787359997.179435:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010752 00000100:00100000:1.0:1787359997.179465:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010496 00000100:00100000:1.0:1787359997.179468:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010496 00000100:00100000:1.0:1787359997.179487:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011008 00000100:00100000:1.0:1787359997.179490:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011008 00000100:00100000:1.0:1787359997.179503:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011520 00000100:00100000:1.0:1787359997.179506:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011520 00000100:00100000:1.0:1787359997.179517:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011136 00000100:00100000:1.0:1787359997.179519:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011136 00000100:00100000:1.0:1787359997.179543:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011648 00000100:00100000:1.0:1787359997.179547:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011648 00000100:00100000:1.0:1787359997.179560:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359997.179566:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596010752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179598:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596010752:12345-0@lo:400:kworker.0 Request processed in 32us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179603:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359997.179617:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787359997.179623:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596010496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179653:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596010496:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179658:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787359997.179668:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787359997.179673:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596011008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179696:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596011008:12345-0@lo:400:kworker.0 Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179702:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787359997.179713:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787359997.179718:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596011520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179740:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596011520:12345-0@lo:400:kworker.0 Request processed in 23us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179753:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787359997.179764:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787359997.179769:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596011136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179794:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596011136:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179799:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787359997.179809:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787359997.179814:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596011648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179837:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596011648:12345-0@lo:400:kworker.0 Request processed in 23us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179842:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787359997.179859:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011264 00000100:00100000:1.0:1787359997.179863:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011264 00000100:00100000:1.0:1787359997.179880:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011776 00000100:00100000:1.0:1787359997.179882:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011776 00000100:00100000:1.0:1787359997.179892:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011392 00000100:00100000:1.0:1787359997.179895:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011392 00000100:00100000:1.0:1787359997.179903:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596011904 00000100:00100000:1.0:1787359997.179906:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596011904 00000100:00100000:1.0:1787359997.179915:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787359997.179921:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596011264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179947:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596011264:12345-0@lo:400:kworker.0 Request processed in 26us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.179952:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787359997.179961:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787359997.179966:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596011776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.179999:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596011776:12345-0@lo:400:kworker.0 Request processed in 33us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180005:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787359997.180015:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359997.180021:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596011392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180044:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596011392:12345-0@lo:400:kworker.0 Request processed in 23us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180049:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359997.180059:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787359997.180064:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596011904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180089:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596011904:12345-0@lo:400:kworker.0 Request processed in 24us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180094:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787359997.180114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010368 00000100:00100000:1.0:1787359997.180117:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010368 00000100:00100000:1.0:1787359997.180146:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787359997.180153:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596010368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180179:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596010368:12345-0@lo:400:kworker.0 Request processed in 27us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787359997.180210:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010880 00000100:00100000:1.0:1787359997.180213:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010880 00000100:00100000:1.0:1787359997.180258:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596010624 00000100:00100000:1.0:1787359997.180262:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596010624 00000100:00100000:1.0:1787359997.180275:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787359997.180280:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596010880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180316:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596010880:12345-0@lo:400:kworker.0 Request processed in 35us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180322:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787359997.180333:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787359997.180338:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596010624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180362:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596010624:12345-0@lo:400:kworker.0 Request processed in 23us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359997.180367:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1787359997.180400:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359997.180404:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787359997.180406:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359997.180408:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359997.180438:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596010624:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180462:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904058380 x1874182596011136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180472:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596011136:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180482:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a3100 x1874182596011648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180490:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596011648:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180500:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596010496:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180509:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596011008:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180517:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596011520:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180555:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596010368:0@lo:400:kworker.0 00000100:00100000:1.0:1787359997.180575:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596010880:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180585:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904059880 x1874182596011392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180593:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596011392:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180602:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a1c00 x1874182596011904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180609:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596011904:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180616:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405a680 x1874182596010240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180627:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596010240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359997.180635:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596010752:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180643:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405ad80 x1874182596011264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180649:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596011264:0@lo:400:kworker.0 00010000:00080000:1.0:1787359997.180657:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a3480 x1874182596011776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359997.180664:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596011776:0@lo:400:kworker.0 00000100:00100000:3.0:1787359997.183320:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787359997.183339:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596012032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787359997.183396:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359997.183439:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012032 00000100:00100000:3.0:1787359997.183454:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012032 00000100:00100000:3.0:1787359997.183496:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359997.183505:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596012032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787359997.183525:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359997.183562:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596012032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359997.183569:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787359997.183605:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510e680 x1874182596012032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359997.183621:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596012032:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787359998.077899:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359998.208187:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359998.208212:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787359998.208300:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359998.208359:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012160 00000100:00100000:2.0:1787359998.208367:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012160 00000100:00100000:2.0:1787359998.208410:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359998.208420:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596012160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787359998.208463:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787359998.208509:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596012160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359998.208516:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359998.208559:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596012160:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787359998.839420:0:10951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing yml_node 00010000:00010000:0.0:1787359999.103093:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359999.227110:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596012288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787359999.227183:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359999.227250:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012288 00000100:00100000:3.0:1787359999.227258:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012288 00000100:00080000:0.0:1787359999.227287:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359999.227323:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787359999.227334:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596012288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359999.227360:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787359999.227406:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596012288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359999.227413:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787359999.227446:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596012416:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787359999.227459:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f480 x1874182596012288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359999.227471:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359999.227476:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596012288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359999.227533:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012416 00000100:00100000:2.0:1787359999.227537:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012416 00000100:00100000:2.0:1787359999.227573:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787359999.227580:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596012416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787359999.227591:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787359999.227633:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596012416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359999.227640:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787359999.227669:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd7800 x1874182596012416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359999.227683:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596012416:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787359999.227690:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359999.346887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359999.346930:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359999.346958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359999.346986:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973568 00000100:00100000:3.0:1787359999.346994:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973568 00000100:00100000:3.0:1787359999.347046:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973440 00000100:00100000:3.0:1787359999.347050:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973440 00000100:00100000:3.0:1787359999.347072:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1787359999.347082:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973568:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787359999.347151:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574973568:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359999.347166:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1787359999.347182:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:3.0:1787359999.347199:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574973440:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787359999.347245:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574973440:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359999.347252:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:0.0:1787359999.347342:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973312 00000100:00100000:0.0:1787359999.347347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973312 00000100:00100000:0.0:1787359999.347382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:0.0:1787359999.347389:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574973312:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787359999.347416:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574973312:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359999.347422:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00080000:0.0:1787359999.347460:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359999.347463:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787359999.348879:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787359999.349004:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973696 00000100:00100000:3.0:1787359999.349013:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973696 00000100:00100000:3.0:1787359999.349090:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1787359999.349101:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182574973696:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:3.0:1787359999.349132:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff84 00000100:00080000:3.0:1787359999.349151:0:8448:0:(import.c:65:import_set_state_nolock()) ffff998903736800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787359999.349203:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787359999.349359:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+2:2398:x1874182574973696:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 259us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359999.349367:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00010000:00010000:0.0:1787359999.350259:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787359999.350270:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359999.351055:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787359999.351128:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973824 00000100:00100000:1.0:1787359999.351138:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973824 00000100:00100000:1.0:1787359999.351211:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1787359999.351221:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182574973824:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:1.0:1787359999.351287:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff8b 00000100:00080000:1.0:1787359999.351298:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998903734000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787359999.351338:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787359999.351479:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+2:2398:x1874182574973824:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 258us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359999.351487:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00010000:00010000:1.0:1787359999.351544:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787359999.351795:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787360000.122423:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360001.147326:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360001.275842:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596012544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360001.275919:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360001.276276:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012544 00000100:00100000:2.0:1787360001.276284:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012544 00000100:00100000:2.0:1787360001.276345:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360001.276353:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596012544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360001.276384:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360001.276457:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596012544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360001.276464:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787360001.276627:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596012544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787360002.169670:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360002.297792:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360002.297828:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596012672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360002.297897:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.298012:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012672 00000100:00100000:1.0:1787360002.298020:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012672 00000100:00100000:1.0:1787360002.298084:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787360002.298096:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596012672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787360002.298121:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360002.298166:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596012672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.298173:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787360002.298210:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a3480 x1874182596012672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.298246:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596012672:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787360002.298452:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360002.299377:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596012800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360002.299411:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596013184:0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.299455:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360002.299465:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360002.299507:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596013696:0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.299515:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596013312:0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.299553:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360002.299570:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013184 00000100:00100000:3.0:1787360002.299577:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013184 00000100:00100000:2.0:1787360002.299584:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596014208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.299620:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360002.299627:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360002.299632:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.299650:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787360002.299658:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596013056:0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.299686:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596013184:12345-0@lo:400:kworker.0 Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360002.299695:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360002.299701:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360002.299719:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596013568:0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.299727:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013696 00000100:00100000:3.0:1787360002.299732:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013696 00000100:00100000:2.0:1787360002.299744:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360002.299776:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596014080:0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.299799:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360002.299812:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596012928:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.299853:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012800 00000100:00100000:0.0:1787360002.299859:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.299860:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012800 00000100:00100000:0.0:1787360002.299890:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596013440:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.299900:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787360002.299909:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596012800:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360002.299917:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360002.299937:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596013952:0@lo:400:kworker.0 00002000:00000024:1.0:1787360002.299938:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360002.299970:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.299986:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596012800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.300004:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787360002.300007:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596012928 00000100:00100000:0.0:1787360002.300011:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596012928 00000100:00100000:1.0:1787360002.300047:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013440 00000100:00100000:0.0:1787360002.300052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787360002.300054:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013440 00000100:00100000:0.0:1787360002.300062:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596012928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.300085:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787360002.300094:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596013440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360002.300103:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596012928:12345-0@lo:400:kworker.0 Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.300111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787360002.300140:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596013440:12345-0@lo:400:kworker.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.300148:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787360002.300160:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596012928:0@lo:400:kworker.0 00000100:00100000:0.0:1787360002.300173:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596013440:0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.309026:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596013184:0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.309180:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013952 00000100:00100000:2.0:1787360002.309188:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013952 00000100:00100000:2.0:1787360002.309258:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360002.309269:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360002.309364:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596013952:12345-0@lo:400:kworker.0 Request processed in 97us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360002.309372:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360002.309460:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014208 00000100:00100000:3.0:1787360002.309465:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014208 00000100:00100000:3.0:1787360002.309494:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013056 00000100:00100000:3.0:1787360002.309498:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013056 00000100:00100000:3.0:1787360002.309510:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013568 00000100:00100000:3.0:1787360002.309512:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013568 00000100:00100000:3.0:1787360002.309524:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014080 00000100:00100000:3.0:1787360002.309526:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014080 00000100:00100000:3.0:1787360002.309542:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787360002.309549:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596013696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.310451:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596013696:12345-0@lo:400:kworker.0 Request processed in 898us (10894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.310471:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787360002.310497:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787360002.310507:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596014208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.310527:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787360002.310539:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360002.310554:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596014208:12345-0@lo:400:kworker.0 Request processed in 49us (10927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.310561:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787360002.310585:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596013056:12345-0@lo:400:kworker.0 Request processed in 49us (10892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.310592:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787360002.310602:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596013568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360002.310656:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00010000:00080000:0.0:1787360002.310690:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903882d80 x1874182596013952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360002.310901:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596013568:12345-0@lo:400:kworker.0 Request processed in 300us (11156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.310928:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596013952:0@lo:400:kworker.0 00000100:00080000:0.0:1787360002.310958:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360002.310963:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360002.310965:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360002.310967:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360002.310976:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787360002.311109:0:9449:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787360002.311138:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787360002.311170:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360002.311178:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311215:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596014080:12345-0@lo:400:kworker.0 Request processed in 38us (11416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.311221:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360002.311432:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596013056:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311445:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596013568:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311455:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596014080:0@lo:400:kworker.0 00010000:00080000:1.0:1787360002.311467:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eddf480 x1874182596013696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.311476:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596013696:0@lo:400:kworker.0 00010000:00080000:1.0:1787360002.311498:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903881180 x1874182596014208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.311506:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596014208:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311559:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.311588:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596013824:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311638:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.311657:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596014336:0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311684:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787360002.311707:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a3480 x1874182596012800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.311724:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596012800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360002.311747:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013824 00000100:00100000:1.0:1787360002.311766:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013824 00000100:00100000:1.0:1787360002.311804:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014336 00000100:00100000:1.0:1787360002.311807:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014336 00000100:00100000:1.0:1787360002.311823:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360002.311828:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596013824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311864:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596013824:12345-0@lo:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.311871:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360002.311884:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360002.311889:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596014336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.311928:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596014336:12345-0@lo:400:kworker.0 Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.311934:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360002.311965:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596013312 00000100:00100000:1.0:1787360002.311968:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596013312 00000100:00100000:1.0:1787360002.311989:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360002.311994:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596013312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360002.312023:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596013312:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.312028:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360002.312055:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596013312:0@lo:400:kworker.0 00010000:00080000:1.0:1787360002.312066:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903883b80 x1874182596013824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.312074:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596013824:0@lo:400:kworker.0 00010000:00080000:1.0:1787360002.312082:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880a80 x1874182596014336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360002.312089:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596014336:0@lo:400:kworker.0 00000100:00080000:1.0:1787360002.312119:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360002.314297:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:0.0:1787360003.193526:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360003.321454:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596014464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360003.321680:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360003.321762:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014464 00000100:00100000:2.0:1787360003.321774:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014464 00000100:00100000:2.0:1787360003.321846:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787360003.321859:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596014464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360003.321892:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787360003.321980:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596014464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.321988:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787360003.322053:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596014464:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787360004.165615:0:11135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.45 00010000:00010000:0.0:1787360004.223329:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360004.348014:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596014592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360004.348116:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360004.348315:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014592 00000100:00100000:0.0:1787360004.348327:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014592 00000100:00100000:0.0:1787360004.348401:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787360004.348426:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596014592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360004.348462:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360004.348523:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596014592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360004.348530:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787360004.348596:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787360004.348637:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3d880 x1874182596014592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360004.348661:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596014592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360004.352522:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360004.352550:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596014720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360004.352650:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360004.352846:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014720 00000100:00100000:0.0:1787360004.352856:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014720 00000100:00100000:0.0:1787360004.352938:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787360004.352948:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596014720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360004.352976:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360004.353028:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596014720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360004.353036:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787360004.353184:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787360004.353220:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f800 x1874182596014720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360004.353281:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596014720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360004.461846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360004.461897:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360004.462016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360004.462069:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974080 00000100:00100000:1.0:1787360004.462089:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974080 00000100:00100000:1.0:1787360004.462169:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974208 00000100:00100000:1.0:1787360004.462173:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974208 00000100:00100000:1.0:1787360004.462207:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360004.462223:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574974080:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360004.462342:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574974080:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 124us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.462350:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360004.462374:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:1.0:1787360004.462381:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574974208:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360004.462420:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574974208:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.462427:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:1.0:1787360004.462449:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574973952 00000100:00100000:1.0:1787360004.462453:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574973952 00000100:00100000:1.0:1787360004.462483:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00100000:1.0:1787360004.462490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574973952:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360004.463580:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182574973952:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1014us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.463598:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 283 00000100:00080000:1.0:1787360004.463702:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360004.463708:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787360004.867988:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:2.0:1787360004.868004:0:8442:0:(genops.c:885:class_export_put()) final put ffff998903731800/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:1.0:1787360004.868191:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998903731800/1121de3d-8714-4863-bc5d-127112ba378a for lustre-OST0000 00000020:00000080:1.0:1787360004.868275:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903736800 for lustre-OST0000 00000001:00100000:2.0:1787360004.879034:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:2.0:1787360004.879168:0:9528:0:(genops.c:885:class_export_put()) final put ffff998903731000/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:1.0:1787360004.882761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998903731000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-OST0001 00000020:00000080:0.0:1787360004.884801:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903734000 for lustre-OST0001 00010000:00010000:1.0:1787360005.241699:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360006.274527:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360006.396716:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596014848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360006.396816:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360006.399470:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014848 00000100:00100000:2.0:1787360006.399490:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014848 00000100:00100000:2.0:1787360006.399559:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787360006.399572:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596014848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360006.399618:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360006.399718:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596014848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360006.399725:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787360006.401499:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596014848:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787360006.972959:0:11233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.45 00010000:00010000:0.0:1787360007.290312:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360007.418136:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596014976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360007.418253:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360007.418381:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596014976 00000100:00100000:3.0:1787360007.418400:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596014976 00000100:00100000:3.0:1787360007.418467:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787360007.418478:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596014976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360007.418513:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360007.418574:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596014976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360007.419490:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360007.419510:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596015104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360007.419563:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360007.420150:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360007.420157:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596015232:0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.420182:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015104 00000100:00100000:3.0:1787360007.420190:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015104 00000100:00100000:0.0:1787360007.420197:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360007.420239:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360007.420249:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596015104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360007.420268:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015232 00000100:00100000:0.0:1787360007.420272:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015232 00002000:00000024:3.0:1787360007.420281:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360007.420305:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787360007.420311:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.420326:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596015104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.420332:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787360007.420340:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596015232:12345-0@lo:400:kworker.0 Request processed in 29us (142us total) trans 0 rc 0/0 00000100:00080000:3.0:1787360007.420350:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360007.420353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787360007.420516:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596015488:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420549:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.420571:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596016000:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420597:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.420612:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596016512:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420633:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787360007.420663:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510c000 x1874182596014976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360007.420685:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596014976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360007.420706:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787360007.420712:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596015360:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420737:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.420753:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596015872:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420772:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.420787:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596016384:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420806:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.420831:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015488 00000100:00100000:0.0:1787360007.420836:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015488 00000100:00100000:0.0:1787360007.420865:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360007.420872:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596015488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420913:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596015488:12345-0@lo:400:kworker.0 Request processed in 41us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.420919:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360007.420953:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596015488:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.420983:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016000 00000100:00100000:0.0:1787360007.420987:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016000 00000100:00100000:3.0:1787360007.421000:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596015232:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421015:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016512 00010000:00080000:3.0:1787360007.421017:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef02a00 x1874182596015104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360007.421018:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016512 00000100:00100000:3.0:1787360007.421031:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596015104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360007.421031:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015360 00000100:00100000:0.0:1787360007.421033:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015360 00000100:00100000:0.0:1787360007.421043:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015872 00000100:00100000:0.0:1787360007.421045:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015872 00000100:00100000:3.0:1787360007.421048:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596015744:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421057:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016384 00000100:00100000:0.0:1787360007.421059:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016384 00000100:00100000:0.0:1787360007.421072:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787360007.421074:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.421078:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596016000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421092:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596016256:0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421114:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.421114:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596016000:12345-0@lo:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.421120:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787360007.421133:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787360007.421138:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596016512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421140:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787360007.421146:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596015616:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421164:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596016512:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.421167:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.421171:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360007.421176:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596016128:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421179:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015616 00000100:00100000:0.0:1787360007.421182:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015616 00000100:00100000:0.0:1787360007.421195:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360007.421196:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360007.421200:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596015360:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787360007.421221:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360007.421247:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360007.421249:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596015360:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.421255:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360007.421269:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596015744 00000100:00100000:3.0:1787360007.421272:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596015744 00000100:00100000:0.0:1787360007.421273:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360007.421278:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596015872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421295:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787360007.421301:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596015744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421305:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596015872:12345-0@lo:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.421311:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360007.421322:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360007.421328:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596016384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421332:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596015744:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.421338:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360007.421352:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596016384:12345-0@lo:400:kworker.0 Request processed in 24us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.421355:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016256 00000100:00100000:0.0:1787360007.421357:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787360007.421358:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016256 00000100:00100000:0.0:1787360007.421366:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787360007.421371:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596015616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421385:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016128 00000100:00100000:3.0:1787360007.421388:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016128 00000100:00100000:3.0:1787360007.421419:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787360007.421426:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596016256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421427:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596015616:12345-0@lo:400:kworker.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.421433:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787360007.421454:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596016256:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.421460:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360007.421461:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596015360:0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421470:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596015872:0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421471:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360007.421477:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596016128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360007.421479:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596016384:0@lo:400:kworker.0 00010000:00080000:0.0:1787360007.421488:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880a80 x1874182596016000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360007.421498:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596016000:0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.421500:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596016128:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.421505:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787360007.421507:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903882d80 x1874182596016512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360007.421526:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596016512:0@lo:400:kworker.0 00000100:00080000:3.0:1787360007.421527:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360007.421552:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596015616:0@lo:400:kworker.0 00010000:00080000:3.0:1787360007.422940:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903883b80 x1874182596016128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360007.422959:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596016128:0@lo:400:kworker.0 00000100:00100000:3.0:1787360007.422990:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596015744:0@lo:400:kworker.0 00010000:00080000:3.0:1787360007.423003:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903881180 x1874182596016256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360007.423012:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596016256:0@lo:400:kworker.0 00010000:00010000:1.0:1787360008.313516:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360008.441618:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596016640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360008.441723:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360008.441966:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016640 00000100:00100000:1.0:1787360008.441977:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016640 00000100:00100000:1.0:1787360008.442048:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787360008.442060:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596016640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360008.442106:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787360008.442173:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596016640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.442180:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787360008.442643:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596016640:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360009.344339:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360009.466486:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596016768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360009.466577:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360009.467039:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016768 00000100:00100000:3.0:1787360009.467051:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016768 00000100:00100000:3.0:1787360009.467134:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360009.467148:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596016768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360009.467183:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360009.467275:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596016768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360009.467283:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787360009.467687:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787360009.467729:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef01c00 x1874182596016768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360009.467758:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596016768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360009.467846:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360009.467862:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596016896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360009.467914:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360009.467969:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596016896 00000100:00100000:2.0:1787360009.467977:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596016896 00000100:00100000:2.0:1787360009.468027:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787360009.468037:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596016896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360009.468052:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360009.468092:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596016896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360009.468099:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1787360009.468118:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787360009.468139:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903881180 x1874182596016896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360009.468153:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596016896:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1787360009.564417:0:11330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.45 00000100:00100000:1.0:1787360009.582107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360009.582165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360009.582206:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360009.582261:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974592 00000100:00100000:3.0:1787360009.582346:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974592 00000100:00100000:3.0:1787360009.582434:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974464 00000100:00100000:3.0:1787360009.582438:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974464 00000100:00100000:3.0:1787360009.582466:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:3.0:1787360009.582492:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574974592:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360009.582518:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:1.0:1787360009.582527:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574974464:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360009.582586:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574974592:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 98us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360009.582594:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00080000:3.0:1787360009.582619:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360009.582624:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360009.582675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974336 00000100:00100000:0.0:1787360009.582680:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974336 00000100:00100000:0.0:1787360009.582712:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 285 00000100:00100000:0.0:1787360009.582719:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574974336:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360009.582767:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574974464:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 241us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360009.582775:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:0.0:1787360009.582975:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574974336:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 255us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360009.582983:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 285 00010000:00010000:0.0:1787360010.362345:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787360011.288143:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 20:53:29 EDT 2026 00010000:00010000:1.0:1787360011.386400:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360011.518293:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596017024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360011.518362:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360011.524432:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017024 00000100:00100000:3.0:1787360011.524445:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017024 00000100:00100000:3.0:1787360011.524506:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787360011.524517:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596017024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360011.524551:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360011.524623:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596017024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (6260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360011.524631:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360011.525009:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596017024:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787360012.410398:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360012.539441:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360012.539465:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596017152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360012.539534:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.539598:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017152 00000100:00100000:3.0:1787360012.539605:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017152 00000100:00100000:3.0:1787360012.539652:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360012.539661:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596017152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360012.539688:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360012.539730:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596017152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.539737:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787360012.539757:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787360012.539784:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0a80 x1874182596017152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360012.539811:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596017152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360012.540725:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596017664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.540770:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.540795:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596018176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.540839:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.540863:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596018688:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.540884:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.540911:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787360012.540917:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596017280:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.540941:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.540960:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596017792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.540981:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.540999:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596018304:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.541020:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360012.541044:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017664 00000100:00100000:1.0:1787360012.541050:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017664 00000100:00100000:1.0:1787360012.541085:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787360012.541094:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596017664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.541136:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596017664:12345-0@lo:400:kworker.0 Request processed in 43us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360012.541142:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787360012.541163:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017792 00000100:00100000:1.0:1787360012.541167:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017792 00000100:00100000:1.0:1787360012.541188:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787360012.541194:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596017792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.541251:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596017792:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360012.541258:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787360012.541288:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596017792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360012.541298:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596017664:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541791:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596017408:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541834:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.541856:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596017920:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541878:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.541895:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596018432:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541915:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.541935:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787360012.541941:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596017536:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541962:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.541977:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596018048:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.541996:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.542010:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596018560:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542041:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360012.542065:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018176 00000100:00100000:3.0:1787360012.542070:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018176 00000100:00100000:3.0:1787360012.542103:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018688 00000100:00100000:3.0:1787360012.542106:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018688 00000100:00100000:3.0:1787360012.542119:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018304 00000100:00100000:3.0:1787360012.542121:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018304 00000100:00100000:3.0:1787360012.542134:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360012.542141:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596018176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542175:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596018176:12345-0@lo:400:kworker.0 Request processed in 35us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542182:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360012.542200:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787360012.542207:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596018688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542255:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596018688:12345-0@lo:400:kworker.0 Request processed in 48us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542261:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787360012.542272:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360012.542278:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596018304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542303:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596018304:12345-0@lo:400:kworker.0 Request processed in 25us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542309:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360012.542332:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017408 00000100:00100000:3.0:1787360012.542335:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017408 00000100:00100000:3.0:1787360012.542350:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017920 00000100:00100000:3.0:1787360012.542352:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017920 00000100:00100000:3.0:1787360012.542376:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018432 00000100:00100000:3.0:1787360012.542380:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018432 00000100:00100000:3.0:1787360012.542392:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018048 00000100:00100000:3.0:1787360012.542394:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018048 00000100:00100000:3.0:1787360012.542404:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018560 00000100:00100000:3.0:1787360012.542406:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018560 00000100:00100000:3.0:1787360012.542418:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787360012.542425:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596017408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542469:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596017408:12345-0@lo:400:kworker.0 Request processed in 44us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542476:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787360012.542489:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787360012.542495:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596017920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542520:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596017920:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542531:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787360012.542542:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787360012.542547:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596018432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542572:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596018432:12345-0@lo:400:kworker.0 Request processed in 25us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542577:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787360012.542586:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787360012.542592:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596018048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542613:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596018048:12345-0@lo:400:kworker.0 Request processed in 22us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542619:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787360012.542628:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787360012.542634:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596018560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542656:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596018560:12345-0@lo:400:kworker.0 Request processed in 22us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542661:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787360012.542677:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017536 00000100:00100000:3.0:1787360012.542680:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017536 00000100:00100000:3.0:1787360012.542703:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360012.542709:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542737:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596017536:12345-0@lo:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360012.542743:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787360012.542773:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360012.542776:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360012.542784:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360012.542786:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360012.542815:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596017536:0@lo:400:kworker.0 00010000:00080000:3.0:1787360012.542827:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405bb80 x1874182596018048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360012.542837:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596018048:0@lo:400:kworker.0 00010000:00080000:3.0:1787360012.542846:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bde300 x1874182596018560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360012.542853:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596018560:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542863:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596017408:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542871:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596017920:0@lo:400:kworker.0 00000100:00100000:3.0:1787360012.542880:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596018432:0@lo:400:kworker.0 00000100:00100000:0.0:1787360012.543055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596017280 00000100:00100000:0.0:1787360012.543060:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596017280 00000100:00100000:0.0:1787360012.543098:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787360012.543105:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596017280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360012.543141:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596017280:12345-0@lo:400:kworker.0 Request processed in 36us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360012.543157:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787360012.543190:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596018816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360012.543254:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360012.543356:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018816 00000100:00100000:0.0:1787360012.543360:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018816 00000100:00100000:0.0:1787360012.543396:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787360012.543403:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596018816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360012.543419:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360012.543453:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596018816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360012.543460:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787360012.543486:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0a80 x1874182596018816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360012.543500:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596018816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360012.543583:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596017280:0@lo:400:kworker.0 00010000:00080000:1.0:1787360012.543595:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bde680 x1874182596018304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360012.543604:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596018304:0@lo:400:kworker.0 00010000:00080000:1.0:1787360012.543613:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bdd180 x1874182596018176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360012.543621:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596018176:0@lo:400:kworker.0 00010000:00080000:1.0:1787360012.543629:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bdfb80 x1874182596018688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360012.543635:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596018688:0@lo:400:kworker.0 00010000:00010000:1.0:1787360013.433422:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360013.561682:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360013.561704:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596018944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360013.561770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.561836:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596018944 00000100:00100000:3.0:1787360013.561901:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596018944 00000100:00100000:3.0:1787360013.562001:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787360013.562021:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596018944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360013.562054:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360013.562110:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596018944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360013.562117:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787360013.562188:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596018944:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787360014.457662:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360014.587449:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596019072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360014.587519:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360014.587594:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019072 00000100:00100000:3.0:1787360014.587601:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019072 00000100:00100000:3.0:1787360014.587657:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787360014.587666:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596019072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360014.587694:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360014.587739:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596019072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360014.587746:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787360014.587765:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787360014.587794:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904042680 x1874182596019072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360014.587812:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596019072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360014.588116:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360014.588126:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596019200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360014.588157:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360014.588266:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019200 00000100:00100000:3.0:1787360014.588271:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019200 00000100:00100000:3.0:1787360014.588304:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360014.588312:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596019200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360014.588324:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360014.588369:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596019200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360014.588375:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787360014.588406:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880e00 x1874182596019200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360014.588419:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596019200:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787360014.588493:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360014.696363:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360014.696413:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360014.696544:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974720 00000100:00100000:2.0:1787360014.696555:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974720 00000100:00100000:2.0:1787360014.696613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 287 00000100:00100000:2.0:1787360014.696624:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574974720:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360014.696703:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574974720:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 81us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360014.696711:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 287 00000100:00100000:3.0:1787360014.697146:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974976 00000100:00100000:3.0:1787360014.697151:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974976 00000100:00100000:3.0:1787360014.697202:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:3.0:1787360014.697210:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574974976:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360014.697289:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574974976:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 79us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360014.697296:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00080000:1.0:1787360014.697414:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787360014.697447:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360014.697543:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574974848 00000100:00100000:3.0:1787360014.697548:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574974848 00000100:00080000:1.0:1787360014.697721:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360014.698014:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:3.0:1787360014.698025:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574974848:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360014.698066:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574974848:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 44us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360014.698073:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 114 00010000:00010000:0.0:1787360015.483021:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360016.511374:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360016.633415:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596019328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360016.633501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360016.633607:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019328 00000100:00100000:2.0:1787360016.633615:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019328 00000100:00100000:2.0:1787360016.633671:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787360016.633681:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596019328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360016.633712:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360016.637842:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596019328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4143us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360016.637856:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787360016.642143:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596019328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787360017.530561:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360017.658602:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360017.658626:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596019456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360017.658697:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360017.658877:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019456 00000100:00100000:3.0:1787360017.658885:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019456 00000100:00100000:3.0:1787360017.658945:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360017.658954:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596019456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360017.658981:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360017.659027:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596019456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360017.659034:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787360017.659071:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904042680 x1874182596019456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360017.659088:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596019456:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787360017.659141:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360017.660499:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596019840:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660556:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660586:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596020352:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660608:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660624:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596020864:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660639:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660657:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787360017.660662:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596019712:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660693:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660708:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596020224:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660725:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660737:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596020736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660752:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.660777:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019840 00000100:00100000:1.0:1787360017.660782:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019840 00000100:00100000:1.0:1787360017.660816:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787360017.660823:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596019840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.660867:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596019840:12345-0@lo:400:kworker.0 Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.660874:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787360017.660894:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020352 00000100:00100000:1.0:1787360017.660897:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020352 00000100:00100000:1.0:1787360017.660927:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020864 00000100:00100000:1.0:1787360017.660938:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020864 00000100:00100000:1.0:1787360017.660955:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019712 00000100:00100000:1.0:1787360017.660958:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019712 00000100:00100000:1.0:1787360017.660968:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020224 00000100:00100000:1.0:1787360017.660970:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020224 00000100:00100000:1.0:1787360017.660981:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020736 00000100:00100000:1.0:1787360017.660983:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020736 00000100:00100000:1.0:1787360017.660997:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787360017.661003:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596020352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661033:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596020352:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661038:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787360017.661050:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787360017.661055:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596020864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661079:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596020864:12345-0@lo:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661083:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787360017.661093:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787360017.661098:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596019712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661122:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596019712:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661127:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787360017.661137:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787360017.661143:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596020224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661165:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596020224:12345-0@lo:400:kworker.0 Request processed in 22us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661170:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787360017.661188:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787360017.661193:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596020736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661221:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596020736:12345-0@lo:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661256:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787360017.661290:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596019968:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661316:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661332:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596020480:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661371:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661390:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596020992:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661409:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661434:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787360017.661440:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596019584:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661481:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596020096:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661510:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596020608:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661525:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360017.661544:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020480 00000100:00100000:1.0:1787360017.661548:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020480 00000100:00100000:1.0:1787360017.661572:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020992 00000100:00100000:1.0:1787360017.661574:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020992 00000100:00100000:1.0:1787360017.661584:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020608 00000100:00100000:1.0:1787360017.661586:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020608 00000100:00100000:1.0:1787360017.661595:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360017.661600:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661641:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596020480:12345-0@lo:400:kworker.0 Request processed in 41us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661647:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360017.661658:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787360017.661663:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596020992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661686:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596020992:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661691:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787360017.661700:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360017.661705:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661732:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596020608:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661737:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360017.661757:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019584 00000100:00100000:1.0:1787360017.661760:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019584 00000100:00100000:1.0:1787360017.661782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787360017.661788:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661813:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596019584:12345-0@lo:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661818:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787360017.661843:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596020096 00000100:00100000:1.0:1787360017.661846:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596020096 00000100:00100000:1.0:1787360017.661866:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787360017.661872:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661899:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596020096:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.661915:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787360017.661937:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360017.661940:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360017.661943:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360017.661945:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787360017.661969:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596019584:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.661982:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596020096:0@lo:400:kworker.0 00010000:00080000:1.0:1787360017.661993:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef02a00 x1874182596020608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360017.662002:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596020608:0@lo:400:kworker.0 00010000:00080000:1.0:1787360017.662011:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef03480 x1874182596020480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360017.662018:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596020480:0@lo:400:kworker.0 00010000:00080000:1.0:1787360017.662026:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904176a00 x1874182596020992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360017.662033:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596020992:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662065:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596019712:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662074:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596020224:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662081:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596020736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662091:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596019840:0@lo:400:kworker.0 00010000:00080000:1.0:1787360017.662100:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef00e00 x1874182596020352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360017.662115:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596020352:0@lo:400:kworker.0 00010000:00080000:1.0:1787360017.662127:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904175500 x1874182596020864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360017.662134:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596020864:0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662158:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596019968 00000100:00100000:1.0:1787360017.662161:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596019968 00000100:00100000:1.0:1787360017.662184:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787360017.662190:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596019968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360017.662247:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596019968:12345-0@lo:400:kworker.0 Request processed in 33us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.662253:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787360017.662281:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596019968:0@lo:400:kworker.0 00000100:00100000:3.0:1787360017.668380:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360017.668399:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596021120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360017.668457:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360017.668497:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021120 00000100:00100000:3.0:1787360017.668511:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021120 00000100:00100000:3.0:1787360017.668553:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787360017.668561:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596021120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360017.668581:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360017.668619:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596021120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360017.668625:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787360017.668661:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904042680 x1874182596021120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360017.668688:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596021120:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787360018.555658:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360018.681456:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360018.681489:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596021248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360018.681556:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360018.681653:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021248 00000100:00100000:3.0:1787360018.681662:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021248 00000100:00100000:3.0:1787360018.681708:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787360018.681716:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596021248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360018.681745:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360018.681790:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596021248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.681797:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787360018.681837:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596021248:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360019.577501:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360019.705503:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596021376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360019.705604:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360019.705746:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021376 00000100:00100000:2.0:1787360019.705757:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021376 00000100:00100000:0.0:1787360019.705782:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596021504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360019.705824:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360019.718272:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021504 00000100:00100000:2.0:1787360019.718294:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021504 00000100:00100000:2.0:1787360019.718384:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360019.718398:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596021376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360019.718441:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360019.718562:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596021376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (12958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360019.718570:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360019.718589:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787360019.718597:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596021504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360019.718607:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360019.718638:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596021504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (12814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360019.718644:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787360019.718679:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787360019.719041:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880e00 x1874182596021504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360019.719079:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596021504:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1787360019.719128:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904177100 x1874182596021376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360019.719142:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596021376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360019.816476:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360019.816566:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360019.816598:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360019.816636:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975360 00000100:00100000:1.0:1787360019.816648:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975360 00000100:00100000:1.0:1787360019.816718:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975232 00000100:00100000:1.0:1787360019.816722:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975232 00000100:00100000:1.0:1787360019.816747:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1787360019.816758:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574975360:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360019.816880:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574975360:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360019.816888:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1787360019.816909:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:1.0:1787360019.816916:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574975232:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360019.816941:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574975232:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360019.816947:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00080000:1.0:1787360019.816968:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360019.816973:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360019.825476:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975104 00000100:00100000:3.0:1787360019.825498:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975104 00000100:00100000:3.0:1787360019.825580:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 289 00000100:00100000:3.0:1787360019.825592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574975104:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360019.825706:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182574975104:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 116us (9244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360019.825715:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 289 00010000:00010000:0.0:1787360020.602492:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360021.634758:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360021.754553:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360021.754572:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596021632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360021.754629:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360021.754688:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021632 00000100:00100000:2.0:1787360021.754695:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021632 00000100:00100000:2.0:1787360021.754730:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787360021.754738:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596021632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360021.754766:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360021.754802:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596021632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360021.754809:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787360021.754860:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596021632:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787360022.656541:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360022.777599:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360022.777620:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360022.777686:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360022.777896:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021760 00000100:00100000:2.0:1787360022.777903:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021760 00000100:00100000:2.0:1787360022.777965:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787360022.777984:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596021760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360022.778010:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360022.778052:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596021760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.778059:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787360022.778079:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360022.778089:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360022.778097:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596021888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360022.778124:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360022.778165:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596021888 00000100:00100000:2.0:1787360022.778169:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596021888 00000100:00100000:2.0:1787360022.778194:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360022.778199:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596021888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360022.778209:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360022.778254:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596021888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.778260:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787360022.778272:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787360022.778292:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904177480 x1874182596021888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360022.778318:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596021888:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787360022.778452:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903880e00 x1874182596021760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360022.778466:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596021760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360022.778627:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596022400:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778655:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.778676:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596022912:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778698:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.778717:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787360022.778722:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596022272:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778744:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.778761:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596022784:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778780:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.778795:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596023296:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778814:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.778840:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022400 00000100:00100000:0.0:1787360022.778845:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022400 00000100:00100000:0.0:1787360022.778871:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022784 00000100:00100000:0.0:1787360022.778874:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022784 00000100:00100000:0.0:1787360022.778893:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023296 00000100:00100000:0.0:1787360022.778902:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023296 00000100:00100000:0.0:1787360022.778921:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787360022.778928:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596022400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.778967:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596022400:12345-0@lo:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360022.779059:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596022144:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779089:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360022.779101:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596022656:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360022.779131:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596023168:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360022.779162:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787360022.779167:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596022016:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360022.779209:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596022528:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779257:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360022.779272:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596023040:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.779292:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360022.779430:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787360022.779444:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022144 00000100:00100000:0.0:1787360022.779448:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022144 00000100:00100000:0.0:1787360022.779461:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022656 00000100:00100000:0.0:1787360022.779464:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022656 00000100:00100000:0.0:1787360022.779476:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023168 00000100:00100000:0.0:1787360022.779478:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023168 00000100:00100000:0.0:1787360022.779491:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787360022.779497:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596022784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.779530:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596022784:12345-0@lo:400:kworker.0 Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360022.779536:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787360022.779547:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787360022.779553:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596023296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.779578:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596023296:12345-0@lo:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360022.779584:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787360022.779595:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787360022.779601:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596022144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360022.779602:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022912 00000100:00100000:1.0:1787360022.779606:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022912 00000100:00100000:1.0:1787360022.779632:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023040 00000100:00100000:1.0:1787360022.779635:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023040 00000100:00100000:2.0:1787360022.779700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022016 00000100:00100000:2.0:1787360022.779705:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022016 00000100:00100000:1.0:1787360022.779723:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787360022.779731:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596022912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.779732:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787360022.779737:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596022016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360022.779764:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596022912:12345-0@lo:400:kworker.0 Request processed in 34us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360022.779770:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787360022.779783:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787360022.779784:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596022144:12345-0@lo:400:kworker.0 Request processed in 183us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360022.779789:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596023040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.779789:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787360022.779807:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787360022.779813:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.783259:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596022016:12345-0@lo:400:kworker.0 Request processed in 3512us (4060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.783273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787360022.783344:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022272 00000100:00100000:2.0:1787360022.783352:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022272 00000100:00100000:2.0:1787360022.783392:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596022528 00000100:00100000:2.0:1787360022.783396:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596022528 00000100:00100000:2.0:1787360022.783411:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787360022.783419:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596022272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.783478:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596022272:12345-0@lo:400:kworker.0 Request processed in 60us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.783502:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787360022.783515:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787360022.783521:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596022528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.783551:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596022528:12345-0@lo:400:kworker.0 Request processed in 30us (4293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.783556:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787360022.783578:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360022.783583:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360022.783586:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360022.783652:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787360022.783661:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596023168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.783694:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596023168:12345-0@lo:400:kworker.0 Request processed in 36us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360022.783700:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787360022.783767:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596022272:0@lo:400:kworker.0 00010000:00080000:2.0:1787360022.783781:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c84c700 x1874182596022784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360022.783792:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596022784:0@lo:400:kworker.0 00010000:00080000:2.0:1787360022.783816:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1c00 x1874182596023296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360022.783825:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596023296:0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.783837:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596022400:0@lo:400:kworker.0 00010000:00080000:2.0:1787360022.783847:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c84ea00 x1874182596022912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360022.783863:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596022912:0@lo:400:kworker.0 00000100:00100000:3.0:1787360022.784730:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596022144:0@lo:400:kworker.0 00000100:00100000:0.0:1787360022.787185:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596022656:12345-0@lo:400:kworker.0 Request processed in 7363us (8054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360022.787198:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787360022.788746:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596022656:0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.788763:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596023168:0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.788791:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596022016:0@lo:400:kworker.0 00000100:00100000:2.0:1787360022.788877:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596022528:0@lo:400:kworker.0 00000100:00100000:1.0:1787360022.790137:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596023040:12345-0@lo:400:kworker.0 Request processed in 10343us (10839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360022.790149:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787360022.791709:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a0700 x1874182596023040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360022.791725:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596023040:0@lo:400:kworker.0 00010000:00010000:0.0:1787360023.676090:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360023.801527:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360023.806705:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596023424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360023.806785:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360023.807382:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023424 00000100:00100000:3.0:1787360023.807391:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023424 00000100:00100000:3.0:1787360023.807445:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787360023.807454:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596023424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360023.807494:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360023.807543:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596023424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.807550:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787360023.807758:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596023424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787360024.697417:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360024.825759:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360024.825781:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596023552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360024.825848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360024.826056:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023552 00000100:00100000:0.0:1787360024.826064:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023552 00000100:00100000:0.0:1787360024.826128:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360024.826139:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596023552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360024.826165:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360024.826209:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596023552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.826216:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1787360024.826332:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35054700 x1874182596023552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360024.826349:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596023552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360024.827521:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360024.827579:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360024.827718:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023680 00000100:00100000:2.0:1787360024.827726:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023680 00000100:00100000:2.0:1787360024.827774:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787360024.827783:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596023680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360024.827799:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360024.827838:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596023680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360024.827844:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787360024.828195:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787360024.828327:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904177480 x1874182596023680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360024.828343:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360024.936774:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360024.936815:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360024.936916:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975744 00000100:00100000:1.0:1787360024.936926:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975744 00000100:00100000:0.0:1787360024.937108:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:0.0:1787360024.937121:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574975744:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360024.937198:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574975744:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.937207:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:3.0:1787360024.937725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975488 00000100:00100000:3.0:1787360024.937731:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975488 00000100:00100000:3.0:1787360024.937771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:3.0:1787360024.937780:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574975488:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360024.937818:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182574975488:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 40us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360024.937825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:3.0:1787360024.937870:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360024.938122:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975616 00000100:00100000:2.0:1787360024.938127:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975616 00000100:00100000:2.0:1787360024.938167:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:2.0:1787360024.938174:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574975616:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360024.938262:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574975616:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360024.938270:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00080000:2.0:1787360024.938288:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360024.938292:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787360025.724857:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787360026.592125:0:12007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:53:45 (1787360025) === 00010000:00010000:0.0:1787360026.746389:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360026.873631:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596023808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360026.873692:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360026.874027:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023808 00000100:00100000:2.0:1787360026.874036:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023808 00000100:00100000:2.0:1787360026.874083:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787360026.874093:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596023808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360026.874123:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360026.874213:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596023808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360026.874219:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787360026.874833:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596023808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360026.998923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.000646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574975872 00000100:00100000:2.0:1787360027.000660:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574975872 00000100:00100000:2.0:1787360027.000725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00100000:2.0:1787360027.000736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+10:8725:x1874182574975872:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787360027.000812:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360027.000832:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040200/0x359a4e2aee720079 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef21 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.000859:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040200/0x359a4e2aee720079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef21 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.000869:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040200/0x359a4e2aee720079 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef21 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.000888:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040200, rc 0) 00000100:00100000:2.0:1787360027.001169:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574975872:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 435us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.001177:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00100000:0.0:1787360027.016192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.016372:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976000 00000100:00100000:1.0:1787360027.016383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976000 00000100:00100000:1.0:1787360027.016434:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 293 00000100:00100000:1.0:1787360027.016443:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574976000:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360027.016868:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574976000:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 424us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.016890:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 293 00000100:00100000:0.0:1787360027.020937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.021047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976128 00000100:00100000:2.0:1787360027.021058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976128 00000100:00100000:2.0:1787360027.021110:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 294 00000100:00100000:2.0:1787360027.021120:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574976128:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787360027.021458:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574976128:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 331us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.021467:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 294 00000100:00100000:3.0:1787360027.031446:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.031580:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976256 00000100:00100000:1.0:1787360027.031594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976256 00000100:00100000:1.0:1787360027.031663:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 295 00000100:00100000:1.0:1787360027.031676:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976256:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360027.031880:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976256:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 205us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.031889:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 295 00000100:00100000:0.0:1787360027.069618:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.069820:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976384 00000100:00100000:2.0:1787360027.069844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976384 00000100:00100000:2.0:1787360027.069916:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 296 00000100:00100000:2.0:1787360027.069929:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976384:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360027.070403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976384:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 473us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.070413:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 296 00000100:00100000:0.0:1787360027.075807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360027.076075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976512 00000100:00100000:3.0:1787360027.076087:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976512 00000100:00100000:3.0:1787360027.076156:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:3.0:1787360027.076168:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976512:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360027.076414:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8729:x1874182574976512:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 247us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.076424:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 297 00000100:00100000:3.0:1787360027.087966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.088180:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976640 00000100:00100000:2.0:1787360027.088192:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976640 00000100:00100000:2.0:1787360027.088301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 298 00000100:00100000:2.0:1787360027.088315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:8725:x1874182574976640:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787360027.088335:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360027.088358:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041e00/0x359a4e2aee720080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef52 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.088416:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041e00/0x359a4e2aee720080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef52 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.088428:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041e00/0x359a4e2aee720080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef52 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.088439:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041e00, rc 0) 00000100:00100000:2.0:1787360027.088509:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:8725:x1874182574976640:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 196us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.088516:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 298 00000100:00100000:0.0:1787360027.092143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.092611:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976768 00000100:00100000:1.0:1787360027.092626:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976768 00000100:00100000:1.0:1787360027.092697:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:1.0:1787360027.092709:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:8725:x1874182574976768:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787360027.092742:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787360027.092772:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787360027.093044:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787360027.093050:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787360027.093052:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787360027.093177:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787360027.095623:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:8725:x1874182574976768:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 2899us (3478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.095644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:3.0:1787360027.098813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.098921:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574976896 00000100:00100000:1.0:1787360027.098933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574976896 00000100:00100000:1.0:1787360027.099003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 300 00000100:00100000:1.0:1787360027.099014:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:8725:x1874182574976896:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787360027.099054:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360027.099075:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef59 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360027.099109:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360027.099122:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360027.099133:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71400, rc 0) 00000100:00100000:1.0:1787360027.099205:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8725:x1874182574976896:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 193us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.099213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 300 00000100:00100000:0.0:1787360027.101580:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.102137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977024 00000100:00100000:1.0:1787360027.102154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977024 00000100:00100000:1.0:1787360027.102346:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:1.0:1787360027.102360:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8725:x1874182574977024:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360027.102586:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8725:x1874182574977024:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 228us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.102595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:0.0:1787360027.104648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.104750:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977152 00000100:00100000:2.0:1787360027.104763:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977152 00000100:00100000:2.0:1787360027.105054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 302 00000100:00100000:2.0:1787360027.105068:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8725:x1874182574977152:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787360027.105274:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8725:x1874182574977152:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 208us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.105283:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 302 00000100:00100000:2.0:1787360027.108598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360027.109375:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977280 00000100:00100000:3.0:1787360027.109390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977280 00000100:00100000:2.0:1787360027.109608:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 303 00000100:00100000:2.0:1787360027.109621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8735:x1874182574977280:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360027.109806:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8735:x1874182574977280:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 187us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.109815:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 303 00000100:00100000:2.0:1787360027.119083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.119277:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977408 00000100:00100000:1.0:1787360027.119301:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977408 00000100:00100000:1.0:1787360027.119371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 304 00000100:00100000:1.0:1787360027.119384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8735:x1874182574977408:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360027.119574:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:8735:x1874182574977408:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 191us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.119589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 304 00000100:00100000:0.0:1787360027.126183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360027.126277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360027.126310:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360027.126351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360027.126389:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977536 00000100:00100000:0.0:1787360027.126402:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977536 00000100:00100000:0.0:1787360027.126447:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977792 00000100:00100000:0.0:1787360027.126450:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977792 00000100:00100000:0.0:1787360027.126458:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978304 00000100:00100000:0.0:1787360027.126460:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978304 00000100:00100000:0.0:1787360027.126497:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978176 00000100:00100000:0.0:1787360027.126500:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978176 00000100:00100000:0.0:1787360027.126521:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:0.0:1787360027.126532:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574978304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360027.126623:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574978304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.126632:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:0.0:1787360027.126651:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:0.0:1787360027.126659:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574978176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360027.126686:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574978176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.126693:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:0.0:1787360027.126705:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1787360027.126709:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1874182574977536:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787360027.126734:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bd1197f3-ef26-42bb-9c8a-916d2431465a@192.168.206.11@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:0.0:1787360027.126775:0:6532:0:(genops.c:1385:class_connect()) connect: client bd1197f3-ef26-42bb-9c8a-916d2431465a, cookie 0x359a4e2aee72008e 00000004:00100000:0.0:1787360027.126819:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787360027.126958:0:6532:0:(import.c:65:import_set_state_nolock()) ffff998902a5e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360027.126992:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2398:x1874182574977536:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 281us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.127000:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1787360027.127013:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1787360027.127017:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1874182574977792:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787360027.127033:0:6532:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bd1197f3-ef26-42bb-9c8a-916d2431465a@192.168.206.11@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:0.0:1787360027.127056:0:6532:0:(genops.c:1385:class_connect()) connect: client bd1197f3-ef26-42bb-9c8a-916d2431465a, cookie 0x359a4e2aee720095 00000004:00100000:0.0:1787360027.127070:0:6532:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787360027.127131:0:6532:0:(import.c:65:import_set_state_nolock()) ffff998902a59000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360027.127156:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2398:x1874182574977792:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 136us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.127163:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00080000:0.0:1787360027.127192:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360027.127196:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360027.134042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.134087:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360027.134119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360027.134282:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978048 00000100:00100000:3.0:1787360027.134305:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978048 00000100:00100000:3.0:1787360027.134385:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977920 00000100:00100000:3.0:1787360027.134388:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977920 00000100:00100000:3.0:1787360027.134414:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574977664 00000100:00100000:3.0:1787360027.134417:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574977664 00000100:00100000:3.0:1787360027.134436:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1787360027.134447:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+7:8725:x1874182574978048:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360027.134497:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360027.134594:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+7:8725:x1874182574978048:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 148us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.134602:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1787360027.134624:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1787360027.134630:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:0:x1874182574977920:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360027.134661:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360027.134705:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:0:x1874182574977920:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 74us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.134711:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:3.0:1787360027.134726:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787360027.134733:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:0:x1874182574977664:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360027.134742:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360027.134764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:0:x1874182574977664:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 31us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.134770:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00080000:2.0:1787360027.137077:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360027.137089:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360027.141175:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360027.141361:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978432 00000100:00100000:3.0:1787360027.141375:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978432 00000100:00100000:3.0:1787360027.141474:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1787360027.141487:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978432:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787360027.141712:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978432:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 227us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.141721:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1787360027.146480:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360027.146521:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.147155:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978560 00000100:00100000:1.0:1787360027.147169:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978560 00000100:00100000:1.0:1787360027.147222:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978688 00000100:00100000:1.0:1787360027.147245:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978688 00000100:00100000:1.0:1787360027.147269:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1787360027.147279:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874182574978560:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360027.147334:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bd1197f3-ef26-42bb-9c8a-916d2431465a@192.168.206.11@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:1.0:1787360027.147372:0:8447:0:(genops.c:1385:class_connect()) connect: client bd1197f3-ef26-42bb-9c8a-916d2431465a, cookie 0x359a4e2aee72009c 00002000:00100000:1.0:1787360027.147388:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd1197f3-ef26-42bb-9c8a-916d2431465a/ffff998903731000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360027.147410:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360027.147506:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787360027.147545:0:8447:0:(import.c:65:import_set_state_nolock()) ffff998903736800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360027.147628:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2398:x1874182574978560:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 347us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.147637:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:1.0:1787360027.147657:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360027.147662:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874182574978688:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360027.147680:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bd1197f3-ef26-42bb-9c8a-916d2431465a@192.168.206.11@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:1.0:1787360027.147698:0:8447:0:(genops.c:1385:class_connect()) connect: client bd1197f3-ef26-42bb-9c8a-916d2431465a, cookie 0x359a4e2aee7200a3 00002000:00100000:1.0:1787360027.147704:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd1197f3-ef26-42bb-9c8a-916d2431465a/ffff998903734000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360027.147716:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360027.147755:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360027.147799:0:8447:0:(import.c:65:import_set_state_nolock()) ffff998903731800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360027.148170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360027.148213:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2398:x1874182574978688:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 548us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.148221:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360027.148694:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978816 00000100:00100000:2.0:1787360027.148703:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978816 00000100:00100000:2.0:1787360027.148751:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360027.148761:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978816:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787360027.148845:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978816:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 86us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.148852:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360027.152664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360027.152768:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574978944 00000100:00100000:3.0:1787360027.152782:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574978944 00000100:00100000:3.0:1787360027.152870:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1787360027.152883:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978944:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787360027.153017:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787360027.153109:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:8725:x1874182574978944:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 228us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.153117:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00010000:00010000:2.0:1787360027.770346:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360027.897490:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360027.897519:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596023936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360027.897621:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360027.897794:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596023936 00000100:00100000:0.0:1787360027.897805:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596023936 00000100:00100000:0.0:1787360027.897873:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787360027.897884:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596023936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360027.897910:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360027.897968:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596023936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.898000:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787360027.898156:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787360027.898188:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec74700 x1874182596023936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360027.898210:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596023936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360027.898698:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596024448:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.898743:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.898765:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596024960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.898904:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596024192:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.898943:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.898962:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596024704:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899046:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.899066:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596025216:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899096:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.899116:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787360027.899121:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596024064:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899146:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.899170:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596024576:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899199:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.899217:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596025088:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899269:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.899314:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024448 00000100:00100000:3.0:1787360027.899321:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024448 00000100:00100000:3.0:1787360027.899366:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024192 00000100:00100000:3.0:1787360027.899369:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024192 00000100:00100000:3.0:1787360027.899380:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024704 00000100:00100000:3.0:1787360027.899382:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024704 00000100:00100000:3.0:1787360027.899402:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025216 00000100:00100000:3.0:1787360027.899405:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025216 00000100:00100000:3.0:1787360027.899419:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787360027.899427:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899470:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596024448:12345-0@lo:400:kworker.0 Request processed in 44us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.899476:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787360027.899492:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787360027.899497:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596024192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899529:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596024192:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.899536:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787360027.899546:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787360027.899559:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899604:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596024704:12345-0@lo:400:kworker.0 Request processed in 44us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.899609:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787360027.899622:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787360027.899627:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899651:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596025216:12345-0@lo:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.899656:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787360027.899683:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024064 00000100:00100000:3.0:1787360027.899687:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024064 00000100:00100000:3.0:1787360027.899723:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787360027.899730:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596024064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.899761:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596024064:12345-0@lo:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.899767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787360027.900165:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.900269:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596025472:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.900307:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.900384:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024576 00000100:00100000:3.0:1787360027.900389:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024576 00000100:00100000:3.0:1787360027.900424:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787360027.900432:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fed2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596024576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.900476:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fed2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596024576:12345-0@lo:400:kworker.0 Request processed in 45us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.900483:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360027.904007:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596024448:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904036:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787360027.904047:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596024320:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904114:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.904134:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596024832:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904155:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.904172:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596025344:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904191:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.904257:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024832 00000100:00100000:1.0:1787360027.904264:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024832 00000100:00100000:1.0:1787360027.904331:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025344 00000100:00100000:1.0:1787360027.904335:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025344 00000100:00100000:1.0:1787360027.904351:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787360027.904360:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596024832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904425:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596024832:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.904448:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787360027.904467:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787360027.904474:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596025344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.904504:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596025344:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.904509:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787360027.907703:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025088 00000100:00100000:0.0:1787360027.907726:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025088 00000100:00100000:0.0:1787360027.907825:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024960 00000100:00100000:0.0:1787360027.907829:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024960 00000100:00100000:0.0:1787360027.907851:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025472 00000100:00100000:0.0:1787360027.907855:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025472 00000100:00100000:0.0:1787360027.907880:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787360027.907893:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596025088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360027.908247:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596025088:12345-0@lo:400:kworker.0 Request processed in 355us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.908257:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787360027.908278:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787360027.908295:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596024960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360027.908331:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596024960:12345-0@lo:400:kworker.0 Request processed in 46us (8167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.908337:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787360027.908349:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787360027.908356:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596025472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360027.908390:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596025472:12345-0@lo:400:kworker.0 Request processed in 35us (8083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.908396:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787360027.908435:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596025600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360027.908483:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360027.908539:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025600 00000100:00100000:0.0:1787360027.908544:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025600 00000100:00100000:0.0:1787360027.908604:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787360027.908613:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596025600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360027.908632:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360027.908672:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596025600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.908679:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787360027.908722:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904174e00 x1874182596025600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360027.908747:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596025600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360027.909725:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596024320 00000100:00100000:0.0:1787360027.909736:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596024320 00000100:00100000:0.0:1787360027.909795:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787360027.909806:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596024320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360027.909872:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596024320:12345-0@lo:400:kworker.0 Request processed in 69us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.909880:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787360027.910131:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360027.910138:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360027.910142:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360027.910145:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360027.910335:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596024064:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.910355:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596024576:0@lo:400:kworker.0 00010000:00080000:3.0:1787360027.910372:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc8000 x1874182596025088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360027.910383:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596025088:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.910398:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596024192:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.910412:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596024704:0@lo:400:kworker.0 00000100:00100000:3.0:1787360027.910424:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596025216:0@lo:400:kworker.0 00000100:00100000:1.0:1787360027.910578:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596024320:0@lo:400:kworker.0 00010000:00080000:1.0:1787360027.910680:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef02300 x1874182596024832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360027.910690:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596024832:0@lo:400:kworker.0 00010000:00080000:1.0:1787360027.910703:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9180 x1874182596025344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360027.910712:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596025344:0@lo:400:kworker.0 00010000:00080000:1.0:1787360027.910724:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef00700 x1874182596024960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360027.910732:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596024960:0@lo:400:kworker.0 00010000:00080000:1.0:1787360027.910744:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bca680 x1874182596025472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360027.910751:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596025472:0@lo:400:kworker.0 00010000:00010000:2.0:1787360028.795774:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360028.925537:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596025728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360028.925634:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360028.925783:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025728 00000100:00100000:3.0:1787360028.925794:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025728 00000100:00100000:3.0:1787360028.925855:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787360028.925866:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596025728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360028.925908:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360028.925974:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596025728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360028.925983:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787360028.926074:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596025728:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360029.817534:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360029.946594:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360029.946617:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596025856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360029.946684:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360029.946754:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025856 00000100:00100000:1.0:1787360029.946762:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025856 00000100:00100000:1.0:1787360029.946811:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360029.946821:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596025856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360029.946852:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360029.946892:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596025856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360029.946900:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787360029.946937:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bca680 x1874182596025856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360029.946954:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596025856:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787360029.947579:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360029.950282:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596025984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360029.950357:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360029.950730:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596025984 00000100:00100000:1.0:1787360029.950739:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596025984 00000100:00100000:1.0:1787360029.950809:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787360029.950820:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596025984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360029.950841:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360029.950892:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596025984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360029.950899:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787360029.951456:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787360029.951531:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bca680 x1874182596025984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360029.951552:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596025984:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787360030.841450:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360031.866841:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360032.001710:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596026112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360032.001782:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360032.002127:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026112 00000100:00100000:2.0:1787360032.002135:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026112 00000100:00100000:2.0:1787360032.002189:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787360032.002199:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596026112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360032.002248:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360032.002309:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596026112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.002316:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360032.002549:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596026112:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787360032.513270:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00100000:1.0:1787360032.520463:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00100000:2.0:1787360032.522732:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00100000:3.0:1787360032.527915:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000100:00100000:2.0:1787360032.626574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360032.626650:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979072 00000100:00100000:3.0:1787360032.626661:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979072 00000100:00100000:3.0:1787360032.626742:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 306 00000100:00100000:3.0:1787360032.626761:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574979072:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360032.626841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574979072:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360032.626849:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 306 00000100:00100000:3.0:1787360032.633353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360032.633426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360032.633479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360032.633498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360032.633513:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979328 00000100:00100000:2.0:1787360032.633521:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979328 00000100:00100000:2.0:1787360032.633577:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979584 00000100:00100000:2.0:1787360032.633580:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979584 00000100:00100000:2.0:1787360032.633601:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1787360032.633610:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574979328:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360032.633675:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574979328:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.633681:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1787360032.633696:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:2.0:1787360032.633702:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574979584:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360032.633722:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574979584:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.633728:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:2.0:1787360032.635297:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979840 00000100:00100000:2.0:1787360032.635307:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979840 00000100:00100000:2.0:1787360032.635357:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787360032.635366:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574979840:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360032.635422:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574979840:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 58us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.635430:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1787360032.636781:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360032.637102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00080000:3.0:1787360032.637120:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360032.637125:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360032.637136:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979712 00000100:00100000:3.0:1787360032.637143:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979712 00000100:00100000:3.0:1787360032.637186:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1787360032.637196:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574979712:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360032.637279:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574979712:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 85us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360032.637286:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00080000:3.0:1787360032.637303:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360032.638125:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979200 00000100:00100000:2.0:1787360032.638131:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979200 00000100:00100000:2.0:1787360032.638168:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979456 00000100:00100000:2.0:1787360032.638177:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979456 00000100:00100000:2.0:1787360032.638203:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1787360032.638211:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574979200:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360032.638274:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574979200:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 64us (4775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.638281:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1787360032.638294:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:2.0:1787360032.638301:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574979456:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360032.638326:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574979456:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360032.638332:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00080000:3.0:1787360032.639463:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787360032.837804:0:12200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787360032.890383:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360033.018275:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596026496:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018349:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018397:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596027008:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018422:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018446:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596027520:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018466:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018493:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787360033.018498:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596026368:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018597:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018619:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596026880:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018641:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018659:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596027392:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018678:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360033.018705:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026496 00000100:00100000:1.0:1787360033.018712:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026496 00000100:00100000:1.0:1787360033.018755:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787360033.018763:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596026496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.018816:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596026496:12345-0@lo:400:kworker.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.018823:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787360033.018854:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027008 00000100:00100000:1.0:1787360033.018858:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027008 00000100:00100000:1.0:1787360033.018883:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027520 00000100:00100000:1.0:1787360033.018886:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027520 00000100:00100000:3.0:1787360033.019012:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596026240:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019045:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019069:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596026752:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019091:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019108:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596027264:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019152:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019172:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596027776:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019193:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019212:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787360033.019218:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596026624:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019280:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596027136:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019301:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019317:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596027648:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019336:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787360033.019363:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360033.019399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026240 00000100:00100000:3.0:1787360033.019403:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026240 00000100:00100000:3.0:1787360033.019432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787360033.019439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596026240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019473:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596026240:12345-0@lo:400:kworker.0 Request processed in 35us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019479:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787360033.019506:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026752 00000100:00100000:3.0:1787360033.019510:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026752 00000100:00100000:3.0:1787360033.019548:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360033.019555:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596026752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019584:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596026752:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019590:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360033.019607:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027264 00000100:00100000:3.0:1787360033.019617:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027264 00000100:00100000:3.0:1787360033.019642:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027776 00000100:00100000:3.0:1787360033.019645:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027776 00000100:00100000:3.0:1787360033.019657:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027136 00000100:00100000:3.0:1787360033.019660:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027136 00000100:00100000:3.0:1787360033.019672:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027648 00000100:00100000:3.0:1787360033.019674:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027648 00000100:00100000:3.0:1787360033.019689:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787360033.019694:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596027264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019725:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596027264:12345-0@lo:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019731:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787360033.019744:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360033.019750:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596027776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019775:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596027776:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019780:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360033.019791:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787360033.019797:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596027136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019822:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596027136:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019828:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787360033.019840:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787360033.019846:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596027648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.019871:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596027648:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.019877:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787360033.019933:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596027904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360033.019962:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360033.019992:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027904 00000100:00100000:3.0:1787360033.019997:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027904 00000100:00100000:3.0:1787360033.020020:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787360033.020027:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596027904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360033.020048:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360033.020082:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596027904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360033.020087:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787360033.020103:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360033.020106:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787360033.020129:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a7480 x1874182596027904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360033.020149:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596027904:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1787360033.020182:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bcb480 x1874182596027136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360033.020190:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596027136:0@lo:400:kworker.0 00010000:00080000:3.0:1787360033.020198:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb0000 x1874182596027648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360033.020205:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596027648:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.020214:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596026240:0@lo:400:kworker.0 00000100:00100000:3.0:1787360033.020246:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596026752:0@lo:400:kworker.0 00010000:00080000:3.0:1787360033.020271:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9c00 x1874182596027264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360033.020287:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596027264:0@lo:400:kworker.0 00010000:00080000:3.0:1787360033.020299:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb0700 x1874182596027776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360033.020306:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596027776:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021022:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026368 00000100:00100000:1.0:1787360033.021028:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026368 00000100:00100000:1.0:1787360033.021042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026880 00000100:00100000:1.0:1787360033.021045:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026880 00000100:00100000:1.0:1787360033.021073:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596027392 00000100:00100000:1.0:1787360033.021075:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596027392 00000100:00100000:1.0:1787360033.021089:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596026624 00000100:00100000:1.0:1787360033.021092:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596026624 00000100:00100000:1.0:1787360033.021109:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787360033.021116:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596027008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021655:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596027008:12345-0@lo:400:kworker.0 Request processed in 537us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.021663:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787360033.021690:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787360033.021697:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596027520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021727:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596027520:12345-0@lo:400:kworker.0 Request processed in 31us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.021733:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787360033.021747:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787360033.021753:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596026368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021777:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596026368:12345-0@lo:400:kworker.0 Request processed in 25us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.021782:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787360033.021794:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787360033.021799:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596026880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021824:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596026880:12345-0@lo:400:kworker.0 Request processed in 25us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.021830:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787360033.021843:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787360033.021849:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596027392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.021887:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596027392:12345-0@lo:400:kworker.0 Request processed in 39us (3208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360033.022100:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360033.022115:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596028032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360033.022218:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787360033.022266:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787360033.022275:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596026624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.022316:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596026624:12345-0@lo:400:kworker.0 Request processed in 43us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360033.022322:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787360033.022381:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596026368:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.022394:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596026880:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.022404:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596027392:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.022414:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596026496:0@lo:400:kworker.0 00010000:00080000:1.0:1787360033.022426:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bcb100 x1874182596027008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360033.022435:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596027008:0@lo:400:kworker.0 00010000:00080000:1.0:1787360033.022445:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc8000 x1874182596027520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360033.022453:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596027520:0@lo:400:kworker.0 00000100:00100000:1.0:1787360033.022491:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596026624:0@lo:400:kworker.0 00000100:00080000:3.0:1787360033.023128:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360033.023273:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360033.023310:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028032 00000100:00100000:0.0:1787360033.023316:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028032 00000100:00100000:0.0:1787360033.023350:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787360033.023357:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596028032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360033.023373:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360033.023409:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596028032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360033.023415:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787360033.023443:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec75180 x1874182596028032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360033.023458:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596028032:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787360033.023657:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787360033.923586:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360034.042047:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360034.042070:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596028160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360034.042151:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360034.042689:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028160 00000100:00100000:3.0:1787360034.042698:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028160 00000100:00100000:3.0:1787360034.042751:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360034.042761:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596028160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360034.042793:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360034.042866:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596028160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360034.042873:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787360034.042959:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596028160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360034.937406:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360035.066666:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360035.066696:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596028288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360035.066790:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360035.066881:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028288 00000100:00100000:1.0:1787360035.066891:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028288 00000100:00100000:1.0:1787360035.066959:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787360035.066971:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596028288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360035.067007:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360035.067060:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596028288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360035.067068:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787360035.067135:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb3800 x1874182596028288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360035.067157:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596028288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360035.067669:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1787360035.067822:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360035.068536:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360035.068610:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360035.068774:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028416 00000100:00100000:1.0:1787360035.068784:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028416 00000100:00100000:1.0:1787360035.068911:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360035.068922:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596028416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360035.068949:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360035.069002:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596028416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360035.069009:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1787360035.069546:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35056300 x1874182596028416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360035.069572:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596028416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787360035.069769:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787360035.962274:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360036.986631:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360037.113908:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596028544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360037.113979:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360037.114150:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028544 00000100:00100000:1.0:1787360037.114158:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028544 00000100:00100000:1.0:1787360037.114210:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787360037.114273:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596028544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360037.114309:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787360037.119064:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596028544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4782us (5073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360037.119079:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360037.119213:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596028544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360037.738161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.738202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360037.738351:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980096 00000100:00100000:0.0:1787360037.738360:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980096 00000100:00100000:0.0:1787360037.738431:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00100000:0.0:1787360037.738442:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574980096:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360037.738523:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182574980096:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 83us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360037.738531:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00080000:0.0:1787360037.738564:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360037.738791:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574979968 00000100:00100000:1.0:1787360037.738796:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574979968 00000100:00100000:1.0:1787360037.738835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 308 00000100:00100000:1.0:1787360037.738843:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182574979968:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360037.738878:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182574979968:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360037.738885:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 308 00000100:00100000:2.0:1787360037.739088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.739120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.739141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.739161:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.739184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360037.739205:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980224 00000100:00100000:2.0:1787360037.739216:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980224 00000100:00100000:2.0:1787360037.739331:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980352 00000100:00100000:2.0:1787360037.739335:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980352 00000100:00100000:2.0:1787360037.739353:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980480 00000100:00100000:2.0:1787360037.739356:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980480 00000100:00100000:2.0:1787360037.739370:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1787360037.739389:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574980224:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360037.739424:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574980224:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 47us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360037.739431:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1787360037.739443:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:2.0:1787360037.739449:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574980352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360037.739470:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574980352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360037.739476:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:2.0:1787360037.739486:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:2.0:1787360037.739492:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574980480:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360037.739513:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574980480:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360037.739519:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:2.0:1787360037.739539:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980608 00000100:00100000:2.0:1787360037.739543:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980608 00000100:00080000:0.0:1787360037.739714:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360037.739718:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360037.739720:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360037.739888:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980736 00000100:00100000:2.0:1787360037.739893:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980736 00000100:00100000:2.0:1787360037.739932:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360037.739939:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574980608:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360037.739984:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574980608:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 45us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360037.739991:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360037.740003:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1787360037.740010:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574980736:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360037.740030:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574980736:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360037.740036:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00080000:0.0:1787360037.740693:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787360038.012992:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360038.141774:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596028672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360038.141857:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.142010:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596029184:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.142040:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.142069:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360038.142077:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596028800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360038.142100:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.142141:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028672 00000100:00100000:1.0:1787360038.142148:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028672 00000100:00100000:1.0:1787360038.142203:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028800 00000100:00100000:1.0:1787360038.142206:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028800 00000100:00100000:1.0:1787360038.142252:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360038.142262:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2f198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596028672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787360038.142308:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360038.142352:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2f198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596028672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.142360:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360038.142524:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787360038.142531:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596028800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787360038.142541:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360038.142564:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596028800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.142571:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787360038.142654:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596029056:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.142695:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360038.142720:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360038.142726:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596028928:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.142753:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360038.142783:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029056 00000100:00100000:0.0:1787360038.142787:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029056 00000100:00100000:0.0:1787360038.142813:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787360038.142819:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596029056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.142850:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596029056:12345-0@lo:400:kworker.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360038.142856:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360038.145556:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029184 00000100:00100000:1.0:1787360038.145572:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029184 00000100:00100000:1.0:1787360038.145635:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787360038.145645:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596029184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.145755:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596029056:0@lo:400:kworker.0 00000100:00080000:0.0:1787360038.147039:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360038.148144:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596029312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.149557:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596029568:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.150820:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596029184:12345-0@lo:400:kworker.0 Request processed in 5170us (8772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.150833:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787360038.150889:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596029696:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.150926:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.150956:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596030208:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.150980:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787360038.151014:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35056d80 x1874182596028800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360038.151038:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596028800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360038.151051:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596029184:0@lo:400:kworker.0 00010000:00080000:1.0:1787360038.151083:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec76300 x1874182596028672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360038.151095:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596028672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360038.151148:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029696 00000100:00100000:1.0:1787360038.151154:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029696 00000100:00100000:1.0:1787360038.151193:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030208 00000100:00100000:1.0:1787360038.151195:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030208 00000100:00100000:1.0:1787360038.151212:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787360038.151219:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596029696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.151289:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596029696:12345-0@lo:400:kworker.0 Request processed in 70us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.151296:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787360038.151306:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787360038.151312:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596030208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.151332:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596030208:12345-0@lo:400:kworker.0 Request processed in 21us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.151338:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787360038.151352:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787360038.151372:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904174a80 x1874182596029696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360038.151380:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596029696:0@lo:400:kworker.0 00010000:00080000:1.0:1787360038.151388:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd4e00 x1874182596030208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360038.151395:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596030208:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.156864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596028928 00000100:00100000:1.0:1787360038.156889:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596028928 00000100:00100000:1.0:1787360038.156953:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787360038.156965:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596028928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.157049:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596028928:12345-0@lo:400:kworker.0 Request processed in 87us (14294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.157056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787360038.157100:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596029440:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.157134:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.157161:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596029952:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.157183:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360038.157219:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029440 00000100:00100000:1.0:1787360038.157222:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029440 00000100:00100000:1.0:1787360038.157272:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787360038.157278:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596029440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.157312:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596029440:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.157318:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787360038.157334:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029952 00000100:00100000:1.0:1787360038.157337:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029952 00000100:00100000:1.0:1787360038.157368:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787360038.157374:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596029952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.157404:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596029952:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.157410:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787360038.157443:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596029440:0@lo:400:kworker.0 00010000:00080000:1.0:1787360038.157473:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd6300 x1874182596029952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360038.157483:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596029952:0@lo:400:kworker.0 00000100:00080000:1.0:1787360038.157504:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360038.162464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360038.162510:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596029824:0@lo:400:kworker.0 00000100:00100000:2.0:1787360038.162544:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360038.162575:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029824 00000100:00100000:2.0:1787360038.162583:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029824 00000100:00100000:2.0:1787360038.162640:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360038.162650:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596029824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360038.162696:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596029824:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360038.162703:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787360038.162724:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787360038.162756:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904174380 x1874182596029824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360038.162771:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596029824:0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.163342:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029312 00000100:00100000:1.0:1787360038.163349:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029312 00000100:00100000:1.0:1787360038.163391:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360038.163399:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596029312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360038.163447:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596029312:12345-0@lo:400:kworker.0 Request processed in 49us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360038.163453:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787360038.165060:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596029312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.170472:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360038.170508:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596030080:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.170533:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360038.170575:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596028928:0@lo:400:kworker.0 00000100:00100000:3.0:1787360038.170655:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596029568 00000100:00100000:3.0:1787360038.170662:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596029568 00000100:00100000:3.0:1787360038.170716:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030080 00000100:00100000:3.0:1787360038.170720:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030080 00000100:00100000:3.0:1787360038.170743:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787360038.170752:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360038.170807:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596029568:12345-0@lo:400:kworker.0 Request processed in 55us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360038.170827:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787360038.170851:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787360038.170857:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360038.170900:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596030080:12345-0@lo:400:kworker.0 Request processed in 43us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360038.170906:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787360038.171309:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360038.171337:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596029568:0@lo:400:kworker.0 00000100:00100000:0.0:1787360038.171356:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596030080:0@lo:400:kworker.0 00010000:00010000:2.0:1787360039.033698:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360039.161606:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360039.161629:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596030336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360039.161697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360039.161864:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030336 00000100:00100000:0.0:1787360039.161881:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030336 00000100:00100000:0.0:1787360039.161929:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787360039.161938:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596030336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360039.161969:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787360039.162025:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596030336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360039.162032:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787360039.162165:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596030336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360040.057864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360040.185811:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360040.185863:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360040.186008:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360040.186397:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030464 00000100:00100000:2.0:1787360040.186418:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030464 00000100:00100000:2.0:1787360040.186549:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787360040.186574:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596030464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360040.186617:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360040.186724:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596030464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360040.186732:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787360040.187049:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787360040.187106:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35056d80 x1874182596030464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360040.187134:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360040.190581:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360040.190601:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596030592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360040.190666:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360040.191154:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030592 00000100:00100000:2.0:1787360040.191162:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030592 00000100:00100000:2.0:1787360040.191273:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360040.191284:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596030592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360040.191308:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360040.191370:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596030592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360040.191387:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1787360040.191624:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35057480 x1874182596030592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360040.191645:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596030592:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787360040.191762:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787360041.082650:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787360041.232693:0:12516:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360041.232941:0:12516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787360042.105434:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360042.233522:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596030720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360042.233584:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360042.233776:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030720 00000100:00100000:2.0:1787360042.233785:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030720 00000100:00100000:2.0:1787360042.233838:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787360042.233846:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596030720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360042.233880:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360042.233927:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596030720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360042.233944:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787360042.234061:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596030720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360042.870502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870575:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870599:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870620:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870659:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360042.870686:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981120 00000100:00100000:0.0:1787360042.870694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981120 00000100:00100000:0.0:1787360042.870757:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981376 00000100:00100000:0.0:1787360042.870760:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981376 00000100:00100000:0.0:1787360042.870773:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980992 00000100:00100000:0.0:1787360042.870775:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980992 00000100:00100000:0.0:1787360042.870785:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981248 00000100:00100000:0.0:1787360042.870787:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981248 00000100:00100000:0.0:1787360042.870801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:0.0:1787360042.870810:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574981120:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.870874:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574981120:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 64us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.870881:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:0.0:1787360042.870897:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1787360042.870915:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981376:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.870941:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981376:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.870947:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1787360042.870959:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:0.0:1787360042.870965:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574980992:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.871006:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574980992:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 41us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.871013:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:0.0:1787360042.871026:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:0.0:1787360042.871032:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981248:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.871054:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981248:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.871069:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:0.0:1787360042.871090:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981632 00000100:00100000:0.0:1787360042.871094:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981632 00000100:00100000:0.0:1787360042.871131:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981504 00000100:00100000:0.0:1787360042.871134:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981504 00000100:00100000:0.0:1787360042.871156:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:0.0:1787360042.871161:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981632:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.871187:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981632:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.871193:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:0.0:1787360042.871213:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:0.0:1787360042.871220:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981504:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360042.871270:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574981504:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 51us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360042.871275:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00080000:0.0:1787360042.871299:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360042.871303:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360042.871305:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360042.871307:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360042.871813:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574980864 00000100:00100000:2.0:1787360042.871819:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574980864 00000100:00100000:2.0:1787360042.871852:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 310 00000100:00100000:2.0:1787360042.871859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574980864:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360042.871911:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574980864:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 51us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360042.871918:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 310 00010000:00010000:1.0:1787360043.138512:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360043.258349:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596030848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360043.258411:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.258455:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596030976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360043.258461:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596031360:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.258483:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.258483:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.258501:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596031488:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.258501:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596031872:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.258522:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.258526:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596031104:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.258553:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.258675:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596032384:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.258698:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.258719:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787360043.258725:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596031232:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.258746:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.258763:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596031744:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.258782:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.258799:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596032256:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.259000:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360043.259050:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031360 00000100:00100000:1.0:1787360043.259057:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031360 00000100:00100000:1.0:1787360043.259964:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787360043.259978:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596031360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.260039:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596031360:12345-0@lo:400:kworker.0 Request processed in 66us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.260046:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787360043.260073:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031872 00000100:00100000:1.0:1787360043.260078:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031872 00000100:00100000:1.0:1787360043.262055:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032384 00000100:00100000:1.0:1787360043.262068:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032384 00000100:00100000:1.0:1787360043.262122:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031232 00000100:00100000:1.0:1787360043.262126:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031232 00000100:00100000:1.0:1787360043.262140:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031744 00000100:00100000:1.0:1787360043.262143:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031744 00000100:00100000:1.0:1787360043.262159:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032256 00000100:00100000:1.0:1787360043.262162:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032256 00000100:00100000:1.0:1787360043.262182:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787360043.262192:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596031872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262289:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596031872:12345-0@lo:400:kworker.0 Request processed in 99us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.262297:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787360043.262313:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787360043.262319:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596032384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262347:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596032384:12345-0@lo:400:kworker.0 Request processed in 28us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.262353:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787360043.262364:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787360043.262369:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596031232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262400:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596031232:12345-0@lo:400:kworker.0 Request processed in 30us (3653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.262405:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787360043.262416:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787360043.262421:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596031744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262447:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596031744:12345-0@lo:400:kworker.0 Request processed in 26us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.262453:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787360043.262464:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787360043.262477:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596032256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262508:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596032256:12345-0@lo:400:kworker.0 Request processed in 32us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.262514:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1787360043.262546:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360043.262562:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787360043.262597:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596031232:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262609:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596031744:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262619:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596032256:0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.262631:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596031360:0@lo:400:kworker.0 00010000:00080000:1.0:1787360043.262644:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd4e00 x1874182596031872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360043.262655:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596031872:0@lo:400:kworker.0 00010000:00080000:1.0:1787360043.262665:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a0a80 x1874182596032384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360043.262673:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596032384:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.263627:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030848 00000100:00100000:2.0:1787360043.263635:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030848 00000100:00100000:2.0:1787360043.263668:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596030976 00000100:00100000:2.0:1787360043.263671:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596030976 00000100:00100000:2.0:1787360043.263687:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360043.263694:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596030848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360043.263717:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360043.263763:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596030848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.263770:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360043.263785:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360043.263792:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596030976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360043.263810:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360043.263840:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596030976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.263846:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360043.263868:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.263902:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596032000:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.263933:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.263959:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596032512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.263988:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787360043.264036:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5f80 x1874182596030976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360043.264052:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596030976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360043.264080:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031104 00000100:00100000:2.0:1787360043.264084:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031104 00000100:00100000:2.0:1787360043.264111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787360043.264117:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596031104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264147:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596031104:12345-0@lo:400:kworker.0 Request processed in 30us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.264154:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787360043.264184:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032000 00000100:00100000:2.0:1787360043.264188:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032000 00000100:00100000:2.0:1787360043.264244:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032512 00000100:00100000:2.0:1787360043.264248:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032512 00000100:00100000:2.0:1787360043.264270:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787360043.264276:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596032000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264313:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596032000:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.264327:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787360043.264339:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787360043.264345:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596032512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264372:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596032512:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.264377:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1787360043.264408:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1f80 x1874182596032000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360043.264417:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596032000:0@lo:400:kworker.0 00010000:00080000:2.0:1787360043.264426:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a0e00 x1874182596032512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360043.264433:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596032512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264606:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596031104:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264615:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596031616:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264642:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.264667:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031616 00000100:00100000:2.0:1787360043.264670:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031616 00000100:00100000:2.0:1787360043.264692:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787360043.264699:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596031616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264731:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596031616:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.264736:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787360043.264759:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596031616:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264772:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596032128:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264796:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.264815:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032128 00000100:00100000:2.0:1787360043.264818:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032128 00000100:00100000:2.0:1787360043.264840:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360043.264845:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596032128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264871:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596032128:12345-0@lo:400:kworker.0 Request processed in 25us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.264877:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787360043.264900:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a2680 x1874182596032128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360043.264909:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596032128:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264915:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596032640:0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.264937:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360043.264956:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032640 00000100:00100000:2.0:1787360043.264959:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032640 00000100:00100000:2.0:1787360043.264980:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360043.264985:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596032640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360043.265012:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596032640:12345-0@lo:400:kworker.0 Request processed in 27us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360043.265018:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1787360043.265041:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a3800 x1874182596032640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360043.265049:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596032640:0@lo:400:kworker.0 00000100:00080000:1.0:1787360043.266272:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360043.266278:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360043.266296:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596031488 00000100:00100000:1.0:1787360043.266302:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596031488 00000100:00100000:1.0:1787360043.266340:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787360043.266348:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596031488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360043.266404:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596031488:12345-0@lo:400:kworker.0 Request processed in 58us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360043.266420:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787360043.266460:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596031488:0@lo:400:kworker.0 00010000:00080000:1.0:1787360043.266493:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb0700 x1874182596030848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360043.266510:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596030848:0@lo:13:osp-pre-1-0.0 00000020:00000004:3.0:1787360043.417660:0:12614:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360043.417899:0:12614:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360044.156320:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360044.286813:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360044.286832:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596032768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360044.286897:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360044.286951:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032768 00000100:00100000:0.0:1787360044.286959:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032768 00000100:00100000:0.0:1787360044.287009:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787360044.287017:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596032768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360044.287058:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787360044.287097:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596032768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360044.287104:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787360044.287140:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596032768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360045.180050:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360045.308508:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596032896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360045.308579:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360045.308693:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596032896 00000100:00100000:3.0:1787360045.308701:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596032896 00000100:00100000:3.0:1787360045.308758:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787360045.308769:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596032896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360045.308796:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360045.308854:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596032896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360045.308861:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787360045.309070:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787360045.309101:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35055f80 x1874182596032896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360045.309120:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596032896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360045.317770:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596033024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360045.317865:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360045.318053:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033024 00000100:00100000:2.0:1787360045.318062:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033024 00000100:00100000:2.0:1787360045.318119:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360045.318128:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596033024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360045.318150:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360045.318214:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596033024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360045.318221:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787360045.318277:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787360045.318303:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904175500 x1874182596033024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360045.318331:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596033024:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1787360045.771922:0:12711:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360045.773377:0:12711:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787360046.220018:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360047.225668:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360047.353625:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360047.353645:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596033152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360047.353748:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360047.354059:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033152 00000100:00100000:1.0:1787360047.354067:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033152 00000100:00100000:1.0:1787360047.354165:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787360047.354175:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596033152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360047.354214:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787360047.354294:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596033152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360047.354300:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787360047.354368:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596033152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360047.977690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977830:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360047.977934:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982016 00000100:00100000:3.0:1787360047.977943:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982016 00000100:00100000:3.0:1787360047.978006:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982272 00000100:00100000:3.0:1787360047.978010:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982272 00000100:00100000:3.0:1787360047.978024:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981888 00000100:00100000:3.0:1787360047.978027:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981888 00000100:00100000:3.0:1787360047.978037:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982144 00000100:00100000:3.0:1787360047.978040:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982144 00000100:00100000:3.0:1787360047.978055:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 169 00000100:00100000:3.0:1787360047.978065:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574982016:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360047.978134:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574982016:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 70us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360047.978143:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 169 00000100:00100000:3.0:1787360047.978160:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:3.0:1787360047.978167:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574982272:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360047.978205:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574982272:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 37us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360047.978212:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:1.0:1787360047.978531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574981760 00000100:00100000:1.0:1787360047.978536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574981760 00000100:00100000:1.0:1787360047.978566:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 312 00000100:00100000:1.0:1787360047.978574:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574981760:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360047.978601:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574981760:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360047.978608:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 312 00000100:00100000:3.0:1787360047.978732:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:3.0:1787360047.978742:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574981888:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360047.978768:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574981888:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360047.978775:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:3.0:1787360047.978787:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:3.0:1787360047.978793:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574982144:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360047.978814:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574982144:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360047.978828:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:3.0:1787360047.978851:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982400 00000100:00100000:3.0:1787360047.978855:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982400 00000100:00100000:3.0:1787360047.978887:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982528 00000100:00100000:3.0:1787360047.978891:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982528 00000100:00100000:3.0:1787360047.978912:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:3.0:1787360047.978918:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2398:x1874182574982400:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:3.0:1787360047.978935:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72009c 00000100:00080000:3.0:1787360047.978942:0:8450:0:(import.c:65:import_set_state_nolock()) ffff998903736800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787360047.979142:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:1.0:1787360047.979164:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2398:x1874182574982528:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:1.0:1787360047.979186:0:8447:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7200a3 00000100:00080000:1.0:1787360047.979192:0:8447:0:(import.c:65:import_set_state_nolock()) ffff998903731800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360047.979290:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787360047.979400:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+2:2398:x1874182574982528:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 237us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360047.979408:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:1.0:1787360047.979425:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787360047.980747:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1787360047.980868:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+2:2398:x1874182574982400:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 1945us (2990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360047.980878:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00080000:3.0:1787360047.980906:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360047.980910:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360047.980913:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360047.980916:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787360047.981649:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787360048.236996:0:12808:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360048.237319:0:12808:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360048.255339:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360048.377940:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596033280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360048.378005:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.378313:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596033408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360048.378343:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.378385:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033280 00000100:00100000:2.0:1787360048.378392:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033280 00000100:00100000:2.0:1787360048.378432:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033408 00000100:00100000:2.0:1787360048.378435:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033408 00000100:00100000:2.0:1787360048.378449:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787360048.378457:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596033280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360048.378488:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360048.378524:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596033280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360048.378531:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787360048.378547:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787360048.378553:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596033408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360048.378561:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360048.378586:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596033408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360048.378592:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787360048.378606:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787360048.378628:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1180 x1874182596033408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360048.378657:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596033408:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787360048.378684:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef30380 x1874182596033280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360048.378695:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596033280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360048.378964:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596033664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.378997:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379017:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596034176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379038:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379054:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596034688:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379073:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379091:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787360048.379097:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596033536:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379120:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379140:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596034048:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379184:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379204:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596034560:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379243:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360048.379271:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033664 00000100:00100000:1.0:1787360048.379275:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033664 00000100:00100000:1.0:1787360048.379302:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034176 00000100:00100000:1.0:1787360048.379305:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034176 00000100:00100000:1.0:1787360048.379325:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034688 00000100:00100000:1.0:1787360048.379328:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034688 00000100:00100000:1.0:1787360048.379344:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787360048.379350:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596033664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379398:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596033664:12345-0@lo:400:kworker.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360048.379404:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787360048.379420:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787360048.379426:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596034176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379453:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596034176:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360048.379458:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787360048.379469:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787360048.379475:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379497:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596034688:12345-0@lo:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360048.379502:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787360048.379522:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034560 00000100:00100000:1.0:1787360048.379525:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034560 00000100:00100000:1.0:1787360048.379548:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787360048.379554:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596034560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379579:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596034560:12345-0@lo:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360048.379584:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787360048.379614:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd6300 x1874182596034560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360048.379625:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596034560:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379760:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596033664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379781:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596034176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360048.379789:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596034688:0@lo:400:kworker.0 00000100:00100000:0.0:1787360048.380014:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034048 00000100:00100000:0.0:1787360048.380018:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034048 00000100:00100000:0.0:1787360048.380057:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787360048.380064:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596034048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360048.380104:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596034048:12345-0@lo:400:kworker.0 Request processed in 40us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360048.380109:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787360048.380133:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596034048:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033536 00000100:00100000:2.0:1787360048.380219:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033536 00000100:00100000:2.0:1787360048.380270:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787360048.380276:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380310:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596033536:12345-0@lo:400:kworker.0 Request processed in 35us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360048.380316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:2.0:1787360048.380359:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360048.380363:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360048.380373:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596033920:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.380420:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596034432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380441:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.380460:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787360048.380466:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596033792:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380486:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.380503:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596034304:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380525:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.380540:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596034816:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380557:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360048.380579:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034432 00000100:00100000:2.0:1787360048.380583:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034432 00000100:00100000:2.0:1787360048.380614:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360048.380621:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596034432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.380768:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596034432:12345-0@lo:400:kworker.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360048.380774:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360048.380792:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033792 00000100:00100000:2.0:1787360048.380796:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033792 00000100:00100000:2.0:1787360048.380816:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787360048.381318:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.381416:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596033792:12345-0@lo:400:kworker.0 Request processed in 593us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360048.381432:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787360048.381458:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596033920 00000100:00100000:2.0:1787360048.381462:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596033920 00000100:00100000:2.0:1787360048.381994:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034304 00000100:00100000:2.0:1787360048.381999:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034304 00000100:00100000:0.0:1787360048.382265:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034816 00000100:00100000:0.0:1787360048.382269:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034816 00000100:00100000:0.0:1787360048.382300:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787360048.382308:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596033920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360048.382363:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596033920:12345-0@lo:400:kworker.0 Request processed in 55us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360048.382369:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787360048.382383:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787360048.382389:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596034304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360048.382419:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596034304:12345-0@lo:400:kworker.0 Request processed in 31us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360048.382425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787360048.382437:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787360048.382442:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360048.382469:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596034816:12345-0@lo:400:kworker.0 Request processed in 27us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360048.382474:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1787360048.382794:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360048.382799:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360048.383044:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596033792:0@lo:400:kworker.0 00010000:00080000:2.0:1787360048.383060:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd4e00 x1874182596034304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360048.383071:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596034304:0@lo:400:kworker.0 00010000:00080000:2.0:1787360048.383082:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904041f80 x1874182596034816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360048.383091:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596034816:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.383101:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596033920:0@lo:400:kworker.0 00010000:00080000:2.0:1787360048.383112:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd7800 x1874182596034432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360048.383120:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596034432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360048.383160:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596033536:0@lo:400:kworker.0 00010000:00010000:1.0:1787360049.277740:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360049.408329:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596034944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360049.409107:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360049.410084:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596034944 00000100:00100000:2.0:1787360049.410094:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596034944 00000100:00100000:3.0:1787360049.410953:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787360049.410963:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596034944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360049.410996:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360049.411059:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596034944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360049.411066:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787360049.411116:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596034944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360050.297397:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360050.425408:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360050.425431:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596035072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360050.425549:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360050.427668:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360050.427687:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596035200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360050.427730:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035072 00000100:00100000:1.0:1787360050.427738:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035072 00000100:00100000:0.0:1787360050.427741:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360050.427785:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035200 00000100:00100000:0.0:1787360050.427789:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035200 00000100:00100000:1.0:1787360050.427790:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787360050.427799:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596035072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360050.427825:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360050.427864:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596035072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360050.427870:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787360050.427887:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787360050.427893:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596035200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360050.427902:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787360050.427931:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360050.427937:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596035200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360050.427943:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1787360050.427979:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef30e00 x1874182596035072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360050.427997:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596035072:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787360050.428851:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ef31500 x1874182596035200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360050.428868:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596035200:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1787360050.571010:0:12906:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787360050.571292:0:12906:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360051.324655:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360052.350298:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360052.481351:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360052.492317:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596035328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360052.492398:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360052.492544:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035328 00000100:00100000:2.0:1787360052.492553:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035328 00000100:00100000:2.0:1787360052.492606:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787360052.492625:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596035328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360052.492658:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360052.492723:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596035328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360052.492730:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787360052.493252:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596035328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360053.100958:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360053.100999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360053.101018:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360053.101034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360053.101053:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360053.101077:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982912 00000100:00100000:2.0:1787360053.101085:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982912 00000100:00100000:2.0:1787360053.101127:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983168 00000100:00100000:2.0:1787360053.101130:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983168 00000100:00100000:2.0:1787360053.101142:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982784 00000100:00100000:2.0:1787360053.101144:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982784 00000100:00100000:2.0:1787360053.101166:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983040 00000100:00100000:2.0:1787360053.101169:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983040 00000100:00100000:3.0:1787360053.101184:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574982656 00000100:00100000:2.0:1787360053.101186:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:3.0:1787360053.101188:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574982656 00000100:00100000:2.0:1787360053.101194:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574982912:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360053.101213:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 314 00000100:00100000:3.0:1787360053.101219:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574982656:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360053.101284:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574982656:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 65us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360053.101293:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 314 00000100:00100000:2.0:1787360053.105830:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574982912:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 4625us (4818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360053.105855:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:2.0:1787360053.105888:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:2.0:1787360053.105902:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574983168:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360053.105954:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574983168:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 58us (4934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360053.105960:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:2.0:1787360053.105972:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:2.0:1787360053.105978:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574982784:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360053.105998:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182574982784:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360053.106003:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:2.0:1787360053.106012:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:2.0:1787360053.106018:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574983040:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360053.106038:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574983040:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (4984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360053.106044:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00080000:2.0:1787360053.106070:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360053.106075:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787360053.369458:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360053.497917:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596035584:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.497995:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.498066:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596036096:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.498107:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.498147:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596036608:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.498180:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.498208:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787360053.498214:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596035712:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.498278:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498290:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596035840:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.498300:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596036224:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498333:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498360:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596036352:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498382:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498397:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596036864:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498430:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498460:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787360053.498468:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596035456:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498515:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596035968:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498537:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498553:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596036480:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498572:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360053.498588:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596036992:0@lo:400:kworker.0 00000100:00100000:2.0:1787360053.498606:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360053.498882:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035712 00000100:00100000:1.0:1787360053.498890:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035712 00000100:00100000:1.0:1787360053.498927:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035968 00000100:00100000:1.0:1787360053.498938:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035968 00000100:00100000:1.0:1787360053.498959:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787360053.498968:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596035712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360053.499016:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596035712:12345-0@lo:400:kworker.0 Request processed in 49us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360053.499022:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787360053.499037:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787360053.499044:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360053.499076:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596035968:12345-0@lo:400:kworker.0 Request processed in 33us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360053.499082:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787360053.499116:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035584 00000100:00100000:0.0:1787360053.499121:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035584 00000100:00100000:0.0:1787360053.499171:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036096 00000100:00100000:0.0:1787360053.499175:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036096 00000100:00100000:0.0:1787360053.499197:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036608 00000100:00100000:0.0:1787360053.499200:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036608 00000100:00100000:0.0:1787360053.499212:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035840 00000100:00100000:0.0:1787360053.499214:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035840 00000100:00100000:0.0:1787360053.499250:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787360053.499257:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596035584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499291:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596035584:12345-0@lo:400:kworker.0 Request processed in 35us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499306:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787360053.499319:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787360053.499325:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596036096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499355:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596036096:12345-0@lo:400:kworker.0 Request processed in 30us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499361:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787360053.499372:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787360053.499380:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596036608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499406:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596036608:12345-0@lo:400:kworker.0 Request processed in 28us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499411:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787360053.499422:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787360053.499427:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596035840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499453:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596035840:12345-0@lo:400:kworker.0 Request processed in 26us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499459:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1787360053.499509:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360053.499555:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036352 00000100:00100000:0.0:1787360053.499559:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036352 00000100:00100000:0.0:1787360053.499582:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036864 00000100:00100000:0.0:1787360053.499585:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036864 00000100:00100000:0.0:1787360053.499595:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036480 00000100:00100000:0.0:1787360053.499597:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036480 00000100:00100000:0.0:1787360053.499606:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036992 00000100:00100000:0.0:1787360053.499609:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036992 00000100:00100000:0.0:1787360053.499621:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787360053.499627:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596036352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499664:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596036352:12345-0@lo:400:kworker.0 Request processed in 37us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499670:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787360053.499682:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787360053.499688:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596036864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499714:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596036864:12345-0@lo:400:kworker.0 Request processed in 27us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499719:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787360053.499729:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787360053.499735:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596036480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499759:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596036480:12345-0@lo:400:kworker.0 Request processed in 25us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499764:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787360053.499775:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787360053.499781:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596036992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499810:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596036992:12345-0@lo:400:kworker.0 Request processed in 30us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499816:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787360053.499840:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596035456 00000100:00100000:0.0:1787360053.499843:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596035456 00000100:00100000:0.0:1787360053.499868:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787360053.499874:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596035456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.499902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596035456:12345-0@lo:400:kworker.0 Request processed in 29us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.499908:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:0.0:1787360053.499945:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360053.499947:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360053.499957:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.499983:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596036736:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.500037:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596035584:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500048:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596036096:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500058:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596036608:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500081:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596037120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360053.500104:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.500128:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596035712:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500142:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360053.500147:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596037248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360053.500181:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360053.500208:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036224 00000100:00100000:0.0:1787360053.500212:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036224 00000100:00100000:0.0:1787360053.500265:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596036736 00000100:00100000:0.0:1787360053.500268:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596036736 00000100:00100000:0.0:1787360053.500282:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787360053.500287:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596036224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500321:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596036224:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.500327:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787360053.500338:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787360053.500344:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.500381:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596036736:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.500387:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787360053.500404:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037120 00000100:00100000:0.0:1787360053.500407:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037120 00000100:00100000:0.0:1787360053.500421:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037248 00000100:00100000:0.0:1787360053.500423:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037248 00000100:00100000:0.0:1787360053.500440:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360053.500447:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596037120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360053.500466:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360053.500494:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596037120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.500500:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360053.500511:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787360053.500517:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596037248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360053.500525:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360053.500548:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596037248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360053.500553:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1787360053.500566:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787360053.500587:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f480 x1874182596037248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501050:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596037248:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787360053.501065:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3e680 x1874182596037120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501075:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596037120:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787360053.501094:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9c00 x1874182596036224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501101:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596036224:0@lo:400:kworker.0 00010000:00080000:0.0:1787360053.501109:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9880 x1874182596036736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501116:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596036736:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.501197:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596035456:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.501210:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596035968:0@lo:400:kworker.0 00010000:00080000:0.0:1787360053.501220:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bca680 x1874182596036480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501255:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596036480:0@lo:400:kworker.0 00010000:00080000:0.0:1787360053.501266:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a7480 x1874182596036992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501272:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596036992:0@lo:400:kworker.0 00000100:00100000:0.0:1787360053.501283:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596035840:0@lo:400:kworker.0 00010000:00080000:0.0:1787360053.501292:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9500 x1874182596036352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501298:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596036352:0@lo:400:kworker.0 00010000:00080000:0.0:1787360053.501306:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35056d80 x1874182596036864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360053.501312:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596036864:0@lo:400:kworker.0 00000001:00100000:0.0:1787360053.514549:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000020:00000080:0.0:1787360053.514557:0:8442:0:(genops.c:885:class_export_put()) final put ffff998903731000/bd1197f3-ef26-42bb-9c8a-916d2431465a 00000020:00000080:3.0:1787360053.514692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998903731000/bd1197f3-ef26-42bb-9c8a-916d2431465a for lustre-OST0000 00000001:00100000:1.0:1787360053.514803:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000020:00000080:1.0:1787360053.514807:0:9528:0:(genops.c:885:class_export_put()) final put ffff998903734000/bd1197f3-ef26-42bb-9c8a-916d2431465a 00000020:00000080:3.0:1787360053.519929:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903736800 for lustre-OST0000 00000020:00000080:3.0:1787360053.519946:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff998903734000/bd1197f3-ef26-42bb-9c8a-916d2431465a for lustre-OST0001 00000020:00000080:3.0:1787360053.520256:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903731800 for lustre-OST0001 00010000:00010000:0.0:1787360054.401194:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360054.524788:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360054.524809:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596037376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360054.524881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360054.525009:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037376 00000100:00100000:3.0:1787360054.525017:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037376 00000100:00100000:3.0:1787360054.525066:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787360054.525075:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596037376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360054.525119:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360054.525181:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596037376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360054.525188:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787360054.525252:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596037376:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787360054.749907:0:13050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787360055.419048:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360055.545577:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596037504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360055.545645:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360055.545884:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360055.545914:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360055.545998:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037504 00000100:00100000:0.0:1787360055.546006:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037504 00000100:00100000:0.0:1787360055.546052:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037632 00000100:00100000:0.0:1787360055.546056:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037632 00000100:00100000:0.0:1787360055.546074:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360055.546084:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596037504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360055.546111:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360055.546171:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596037504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360055.546179:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360055.546196:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787360055.546203:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596037632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360055.546213:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787360055.546358:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ee5ea00 x1874182596037504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360055.546375:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596037504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787360055.550625:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360055.551016:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596037632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4807us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360055.551030:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1787360055.551586:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f800 x1874182596037632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360055.551610:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596037632:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787360056.442362:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360057.471092:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360057.593675:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596037760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360057.593800:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360057.593864:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596037760 00000100:00100000:3.0:1787360057.593873:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596037760 00000100:00100000:3.0:1787360057.593921:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787360057.593931:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596037760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360057.593965:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360057.594032:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596037760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360057.594039:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787360057.594162:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596037760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360058.216962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360058.217054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360058.217080:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360058.217099:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360058.217121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360058.217160:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983552 00000100:00100000:0.0:1787360058.217170:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983552 00000100:00100000:0.0:1787360058.217240:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983808 00000100:00100000:0.0:1787360058.217243:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983808 00000100:00100000:0.0:1787360058.217268:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983424 00000100:00100000:0.0:1787360058.217271:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983424 00000100:00100000:0.0:1787360058.217281:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983680 00000100:00100000:0.0:1787360058.217283:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983680 00000100:00100000:0.0:1787360058.217297:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:0.0:1787360058.217306:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574983552:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360058.217371:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574983552:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.217378:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:0.0:1787360058.217395:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:1.0:1787360058.217401:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983296 00000100:00100000:0.0:1787360058.217401:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574983808:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360058.217405:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983296 00000100:00100000:0.0:1787360058.217424:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574983808:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.217430:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:1.0:1787360058.217434:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 316 00000100:00100000:1.0:1787360058.217440:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574983296:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360058.217440:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:0.0:1787360058.217445:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574983424:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360058.217465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574983296:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.217465:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574983424:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 19us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360058.217471:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 316 00000100:00100000:0.0:1787360058.217471:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:0.0:1787360058.217480:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:0.0:1787360058.217486:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574983680:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:1.0:1787360058.217494:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360058.217498:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360058.217508:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574983680:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.217521:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 192 00010000:00010000:0.0:1787360058.490158:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360058.500758:0:13198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc863650f0 20000000:00000080:1.0:1787360058.500776:0:13198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9989039e3800 uarg=0000000000000000 20000000:01000000:1.0:1787360058.500817:0:13198:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787360058.500824:0:13198:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787360058.500828:0:13198:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787360058.502034:0:13199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787360058.502216:0:13198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787360058.524301:0:13198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787360058.524371:0:13198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524391:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524468:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524477:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72004f expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524484:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72005d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524491:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72006b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524499:0:13198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524506:0:13198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524550:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524576:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 12 pid: 6525 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.524592:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596037888:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360058.524747:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524756:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.524765:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038016:0@lo:104: 00000100:00100000:1.0:1787360058.524816:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360058.524846:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.524854:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 23 pid: 6526 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.524861:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038144:0@lo:104: 00000100:00100000:1.0:1787360058.524883:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360058.524909:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038016 00000100:00100000:1.0:1787360058.524915:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038016 00000100:00100000:1.0:1787360058.524951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038144 00000100:00100000:1.0:1787360058.524954:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038144 00000100:00100000:1.0:1787360058.524966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787360058.524974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13198:x1874182596038016:12345-0@lo:104: 00010000:00010000:1.0:1787360058.525365:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525440:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360058.525446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13198:x1874182596038016:12345-0@lo:104: Request processed in 472us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360058.525454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787360058.525473:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787360058.525479:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13198:x1874182596038144:12345-0@lo:104: 00010000:00010000:1.0:1787360058.525487:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525518:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787360058.525523:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13198:x1874182596038144:12345-0@lo:104: Request processed in 45us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360058.525528:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1787360058.525562:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525571:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.525579:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038272:0@lo:104: 00000100:00100000:1.0:1787360058.525602:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360058.525624:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525632:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.525640:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038400:0@lo:104: 00000100:00100000:1.0:1787360058.525669:0:13198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360058.525688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038272 00000100:00100000:1.0:1787360058.525692:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038272 00000100:00100000:1.0:1787360058.525710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038400 00000100:00100000:1.0:1787360058.525712:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038400 00000100:00100000:1.0:1787360058.525721:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787360058.525727:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13198:x1874182596038272:12345-0@lo:104: 00010000:00010000:1.0:1787360058.525735:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525765:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787360058.525782:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13198:x1874182596038272:12345-0@lo:104: Request processed in 56us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360058.525788:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787360058.525800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787360058.525806:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13198:x1874182596038400:12345-0@lo:104: 00010000:00010000:1.0:1787360058.525813:0:6515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525836:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787360058.525841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13198:x1874182596038400:12345-0@lo:104: Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360058.525847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787360058.525872:0:13198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.525882:0:13198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 12 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360058.525902:0:13198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038528:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360058.525933:0:13198:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a50e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360058.525951:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038016:0@lo:104: 00000100:00100000:1.0:1787360058.525959:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038144:0@lo:104: 00000100:00100000:1.0:1787360058.525965:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038272:0@lo:104: 00000100:00100000:1.0:1787360058.525971:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038400:0@lo:104: 00010000:00010000:3.0:1787360058.526020:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787360058.526027:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526034:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360058.526039:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526048:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360058.526055:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360058.526060:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360058.526104:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526111:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360058.526137:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526151:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35040a00/0x359a4e2aee72006b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720072 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526163:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787360058.526166:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526172:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360058.526175:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526182:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360058.526188:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360058.526192:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360058.526206:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526212:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360058.526218:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526262:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee72005d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720064 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526271:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360058.526280:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526286:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360058.526289:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526295:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360058.526301:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360058.526306:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360058.526320:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526326:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360058.526341:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526347:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01517400/0x359a4e2aee72004f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720056 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526357:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360058.526360:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526366:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aba00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360058.526369:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526386:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360058.526393:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360058.526398:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360058.526411:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526417:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360058.526422:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526428:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee720041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee720048 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.526440:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360058.526442:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360058.526444:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360058.526450:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360058.526905:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596038656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.526950:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.526997:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360058.527003:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596038784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.527033:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.527073:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596039040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.527207:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.527253:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360058.527260:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596038912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.527282:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.527307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038656 00000100:00100000:2.0:1787360058.527313:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038656 00010000:00010000:2.0:1787360058.527340:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 24 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.527359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038784 00000100:00100000:2.0:1787360058.527361:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038784 00010000:00010000:2.0:1787360058.527371:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 25 pid: 6526 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.527380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039040 00000100:00100000:2.0:1787360058.527383:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039040 00010000:00010000:2.0:1787360058.527391:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 26 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.527473:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596038912 00000100:00100000:2.0:1787360058.527477:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596038912 00010000:00010000:2.0:1787360058.527489:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.527503:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360058.527510:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+27:3658:x1874182596038656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360058.527521:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360058.527527:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527543:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527558:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516600/0x359a4e2aee720072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72006b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527572:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360058.527605:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+26:3658:x1874182596038656:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.527612:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360058.527628:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360058.527634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+25:3658:x1874182596038784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360058.527642:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360058.527647:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 25 pid: 6526 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527655:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 25 pid: 6526 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527664:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517000/0x359a4e2aee720064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72005d expref: 25 pid: 6526 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527672:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360058.527694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596038784:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.527700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360058.527711:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787360058.527717:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3661:x1874182596039040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360058.527732:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360058.527736:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527744:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527754:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01517e00/0x359a4e2aee720048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee720041 expref: 23 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.527763:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360058.527870:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360058.527880:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3661:x1874182596038912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360058.527888:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360058.527893:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 22 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.527901:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 22 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.527920:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040000/0x359a4e2aee720056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72004f expref: 22 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.527929:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360058.527960:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3661:x1874182596038912:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360058.527965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787360058.528085:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3661:x1874182596039040:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.528092:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787360058.528325:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360058.528468:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596038784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.528482:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596038656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.528512:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596038912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360058.528519:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596039040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360058.534142:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596037888:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360058.534160:0:13198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13198:1874182596038528:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360058.534191:0:13198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.544906:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360058.545000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360058.545090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574983936 00000100:00100000:3.0:1787360058.545108:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574983936 00010000:00010000:3.0:1787360058.545153:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 13 pid: 6525 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360058.545187:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984064 00000100:00100000:3.0:1787360058.545191:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984064 00010000:00010000:3.0:1787360058.545283:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 14 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360058.545309:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:3.0:1787360058.545318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+14:2399:x1874182574983936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360058.545331:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360058.545337:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 14 pid: 6525 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.545350:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 14 pid: 6525 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.545367:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71400/0x359a4e2aee720087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef59 expref: 14 pid: 6525 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360058.545394:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360058.545556:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:2.0:1787360058.545566:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182574984064:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360058.545574:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360058.545580:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 13 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545599:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 13 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545609:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516000/0x359a4e2aee72003a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef1a expref: 13 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545622:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545629:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545645:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545651:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545657:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545663:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545669:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360058.545673:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545695:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545720:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360058.545730:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360058.545776:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:2400:x1874182574984064:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 212us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.545783:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1787360058.546067:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:2399:x1874182574983936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 749us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360058.546075:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00010000:00010000:1.0:1787360058.546415:0:13198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.546425:0:13198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360058.546431:0:13198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70600/0x359a4e2aee7200aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360058.619722:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596039168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360058.619786:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.619832:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596039680:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.619857:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.619876:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596040192:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.619911:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.619929:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596040704:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.619949:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.619968:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787360058.619974:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596039296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360058.619993:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620012:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596039808:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620049:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596040320:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620069:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620082:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596040832:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620115:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620160:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596039552:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620185:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620207:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596040064:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620257:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620272:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596040576:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620291:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620306:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787360058.620312:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596039424:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620330:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620346:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596039936:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620363:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620376:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596040448:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620394:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360058.620421:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039168 00000100:00100000:2.0:1787360058.620428:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039168 00000100:00100000:2.0:1787360058.620465:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039296 00000100:00100000:2.0:1787360058.620468:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039296 00000100:00100000:2.0:1787360058.620485:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787360058.620493:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596039168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360058.620531:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360058.620570:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596039168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620577:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787360058.620592:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787360058.620598:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596039296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360058.620607:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360058.620637:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596039296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620643:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787360058.620661:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039680 00000100:00100000:2.0:1787360058.620664:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039680 00000100:00100000:2.0:1787360058.620681:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040064 00000100:00100000:2.0:1787360058.620683:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040064 00000100:00100000:2.0:1787360058.620695:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040576 00000100:00100000:2.0:1787360058.620697:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040576 00000100:00100000:2.0:1787360058.620709:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039424 00000100:00100000:2.0:1787360058.620711:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039424 00000100:00100000:2.0:1787360058.620720:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039936 00000100:00100000:2.0:1787360058.620723:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039936 00000100:00100000:2.0:1787360058.620733:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040448 00000100:00100000:2.0:1787360058.620735:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040448 00000100:00100000:2.0:1787360058.620747:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787360058.620753:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596039680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596039680:12345-0@lo:400:kworker.0 Request processed in 31us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787360058.620804:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787360058.620810:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596040064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620841:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596040064:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620846:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787360058.620858:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787360058.620864:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596040576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620890:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596040576:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620904:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787360058.620916:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787360058.620922:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596039424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620950:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596039424:12345-0@lo:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.620955:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787360058.620965:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787360058.620972:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596039936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.620998:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596039936:12345-0@lo:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.621003:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787360058.621014:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787360058.621020:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621045:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596040448:12345-0@lo:400:kworker.0 Request processed in 26us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.621050:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787360058.621069:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039808 00000100:00100000:2.0:1787360058.621073:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039808 00000100:00100000:2.0:1787360058.621092:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596039552 00000100:00100000:2.0:1787360058.621095:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596039552 00000100:00100000:2.0:1787360058.621107:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787360058.621112:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596039808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621156:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596039808:12345-0@lo:400:kworker.0 Request processed in 43us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.621162:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787360058.621180:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787360058.621185:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596039552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621217:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596039552:12345-0@lo:400:kworker.0 Request processed in 32us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360058.621246:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787360058.621272:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360058.621276:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360058.621278:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360058.621306:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596039424:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621316:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596039936:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621324:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596040448:0@lo:400:kworker.0 00000100:00100000:2.0:1787360058.621331:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596039552:0@lo:400:kworker.0 00010000:00080000:2.0:1787360058.621342:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3d500 x1874182596040064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360058.621351:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596040064:0@lo:400:kworker.0 00010000:00080000:2.0:1787360058.621360:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3e680 x1874182596040576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360058.621368:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596040576:0@lo:400:kworker.0 00010000:00080000:2.0:1787360058.621401:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc9500 x1874182596039296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360058.621416:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596039296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360058.621427:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596039808:0@lo:400:kworker.0 00010000:00080000:2.0:1787360058.621449:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a0fc31500 x1874182596039168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360058.621460:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596039168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360058.621470:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596039680:0@lo:400:kworker.0 00000100:00100000:0.0:1787360058.621562:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040192 00000100:00100000:0.0:1787360058.621566:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040192 00000100:00100000:0.0:1787360058.621597:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040704 00000100:00100000:0.0:1787360058.621600:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040704 00000100:00100000:0.0:1787360058.621610:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040320 00000100:00100000:0.0:1787360058.621613:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040320 00000100:00100000:0.0:1787360058.621622:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040832 00000100:00100000:0.0:1787360058.621625:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040832 00000100:00100000:0.0:1787360058.621635:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360058.621641:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360058.621681:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596040192:12345-0@lo:400:kworker.0 Request processed in 40us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.621687:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787360058.621699:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360058.621705:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596040704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360058.621728:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596040704:12345-0@lo:400:kworker.0 Request processed in 24us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.621733:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787360058.621743:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787360058.621748:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596040320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360058.621771:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596040320:12345-0@lo:400:kworker.0 Request processed in 23us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.621776:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787360058.621786:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787360058.621792:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596040832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360058.621825:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596040832:12345-0@lo:400:kworker.0 Request processed in 33us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.621830:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1787360058.621875:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3fb80 x1874182596040320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360058.621883:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596040320:0@lo:400:kworker.0 00010000:00080000:0.0:1787360058.621892:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a3480 x1874182596040832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360058.621899:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596040832:0@lo:400:kworker.0 00010000:00080000:0.0:1787360058.621907:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3dc00 x1874182596040192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360058.621915:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596040192:0@lo:400:kworker.0 00010000:00080000:0.0:1787360058.621922:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f480 x1874182596040704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360058.621929:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596040704:0@lo:400:kworker.0 00000100:00080000:2.0:1787360058.622562:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360059.514801:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360059.643018:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360059.643051:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596040960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360059.643152:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360059.643474:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596040960 00000100:00100000:1.0:1787360059.643486:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596040960 00000100:00100000:1.0:1787360059.643554:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787360059.643566:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596040960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360059.643618:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787360059.643981:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596040960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 408us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.643995:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787360059.646816:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596040960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360059.756566:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360059.764919:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984192 00000100:00100000:1.0:1787360059.764938:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984192 00000100:00100000:1.0:1787360059.765022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 317 00000100:00100000:1.0:1787360059.765033:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:6174:x1874182574984192:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360059.765055:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360059.765088:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef8a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.765131:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.765143:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.765154:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71800, rc 0) 00000100:00100000:1.0:1787360059.765244:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984192:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 213us (8692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.765252:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 317 00000100:00100000:3.0:1787360059.768370:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360059.768419:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984320 00000100:00100000:3.0:1787360059.768429:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984320 00000100:00100000:3.0:1787360059.768478:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 318 00000100:00100000:3.0:1787360059.768489:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984320:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360059.770829:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984320:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 2328us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.770847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 318 00000100:00100000:2.0:1787360059.776270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360059.776759:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984448 00000100:00100000:3.0:1787360059.776770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984448 00000100:00100000:3.0:1787360059.776866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:3.0:1787360059.776878:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984448:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360059.777019:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984448:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 144us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.777027:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:1.0:1787360059.783219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360059.784726:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984576 00000100:00100000:2.0:1787360059.784745:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984576 00000100:00100000:2.0:1787360059.784817:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:2.0:1787360059.784828:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574984576:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360059.784849:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360059.784873:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef91 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.784909:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.784923:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.784934:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040a00, rc 0) 00000100:00100000:2.0:1787360059.785015:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574984576:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 188us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360059.785023:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:0.0:1787360059.792082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360059.792177:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984704 00000100:00100000:3.0:1787360059.792199:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984704 00000100:00100000:3.0:1787360059.792292:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:3.0:1787360059.792319:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574984704:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360059.792720:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574984704:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 401us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.792729:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:0.0:1787360059.810391:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360059.814577:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984832 00000100:00100000:3.0:1787360059.814594:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984832 00000100:00100000:3.0:1787360059.814875:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 322 00000100:00100000:3.0:1787360059.814888:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574984832:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360059.815079:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574984832:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 193us (4705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.815088:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 322 10000000:01000000:1.0:1787360060.409396:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787360060.409404:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998902639800 from 7 10000000:01000000:1.0:1787360060.409410:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360060.409503:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.409526:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.409553:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360060.409580:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360060.409651:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360060.409723:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.410017:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041088 00000100:00100000:2.0:1787360060.410025:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041088 00000100:00100000:2.0:1787360060.410083:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1787360060.410093:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182596041088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360060.410287:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360060.410302:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7200bf expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.410327:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.410337:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.410347:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041800, rc 0) 00000100:00100000:2.0:1787360060.410397:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 305us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.410403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787360060.410625:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360060.410640:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.410649:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360060.410709:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360060.410735:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360060.410767:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787360060.410949:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041216 00000100:00100000:0.0:1787360060.410955:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041216 00000100:00100000:0.0:1787360060.410994:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1787360060.411002:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.411131:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.411138:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787360060.412095:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.412152:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.412204:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360060.412274:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360060.412343:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041344 00000100:00100000:0.0:1787360060.412349:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041344 00000100:00100000:0.0:1787360060.412391:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787360060.412400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.412495:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.412502:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787360060.412753:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787360060.420606:0:13254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787360060.420824:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787360060.420846:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360060.420857:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.420881:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360060.420893:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787360060.420896:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61e800 from 7 10000000:01000000:0.0:1787360060.420898:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360060.420948:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.420957:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.420968:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360060.421010:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.421075:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.421126:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360060.421276:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041472 00000100:00100000:1.0:1787360060.421284:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041472 00000100:00100000:1.0:1787360060.421347:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787360060.421358:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596041472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360060.421370:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360060.421384:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7200cd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.421418:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.421429:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360060.421438:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70200, rc 0) 00000100:00100000:1.0:1787360060.421477:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360060.421483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787360060.423206:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360060.423261:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.423274:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360060.423367:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.423416:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.423446:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360060.423646:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041600 00000100:00100000:3.0:1787360060.423653:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041600 00000100:00100000:3.0:1787360060.423702:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787360060.423711:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.423822:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360060.423830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787360060.424108:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.424153:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.424197:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.424220:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.424454:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041728 00000100:00100000:2.0:1787360060.424460:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041728 00000100:00100000:2.0:1787360060.424487:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787360060.424493:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.424583:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.424591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1787360060.424639:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787360060.425650:0:13255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787360060.425843:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787360060.425890:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360060.425901:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.425922:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360060.425945:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360060.425947:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a10f4d000 from 7 10000000:01000000:3.0:1787360060.425949:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360060.425978:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.425985:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.425994:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360060.426013:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.426061:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360060.426102:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.426547:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041856 00000100:00100000:2.0:1787360060.426554:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041856 00000100:00100000:2.0:1787360060.426600:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1787360060.426610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596041856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360060.426622:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360060.426635:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7200db expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.426656:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7200db expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.426666:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200db expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.426674:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040600, rc 0) 00000100:00100000:2.0:1787360060.426713:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596041856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.426720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1787360060.426835:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360060.426849:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.426974:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360060.427036:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.427065:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360060.427098:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.427448:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596041984 00000100:00100000:2.0:1787360060.427454:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596041984 00000100:00100000:2.0:1787360060.427525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1787360060.427534:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596041984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.427662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596041984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.427670:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787360060.427733:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596041984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.427764:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.427812:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360060.431557:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360060.432340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042112 00000100:00100000:0.0:1787360060.432350:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042112 00000100:00100000:0.0:1787360060.432406:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787360060.432416:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596042112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.432556:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596042112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.432564:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787360060.434097:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787360060.435832:0:13256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787360060.436326:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787360060.436349:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360060.436360:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.436372:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360060.436382:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360060.436385:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a0ffaa800 from 7 10000000:01000000:3.0:1787360060.436388:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360060.436425:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.436432:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.436442:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360060.436466:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.436529:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.436690:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042240 00000100:00100000:0.0:1787360060.436697:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042240 00000100:00100000:0.0:1787360060.436737:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787360060.436745:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596042240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360060.436757:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360060.436769:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7200e9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.436791:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.436801:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.436809:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688600, rc 0) 00000100:00100000:0.0:1787360060.436843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596042240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.436849:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787360060.437015:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360060.437035:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360060.437048:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.437056:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360060.437129:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.437155:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360060.437178:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360060.437658:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042368 00000100:00100000:0.0:1787360060.437664:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042368 00000100:00100000:0.0:1787360060.437692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787360060.437701:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596042368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360060.437816:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596042368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.437823:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787360060.438676:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.438726:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360060.438786:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360060.439285:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.439721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042496 00000100:00100000:2.0:1787360060.439739:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042496 00000100:00100000:2.0:1787360060.447165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787360060.447191:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596042496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.447392:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596042496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (8604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.447400:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1787360060.447485:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596042496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787360060.448167:0:13257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787360060.448254:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787360060.448274:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360060.448283:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.448293:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360060.538323:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360060.667075:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596042624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360060.667194:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.667306:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596042752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360060.667342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360060.667379:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042624 00000100:00100000:0.0:1787360060.667386:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042624 00000100:00100000:0.0:1787360060.667427:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042752 00000100:00100000:0.0:1787360060.667431:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042752 00000100:00100000:0.0:1787360060.667447:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787360060.667455:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596042624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360060.667482:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360060.667520:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596042624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.667526:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787360060.667541:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787360060.667546:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596042752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360060.667558:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360060.667808:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596042752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360060.667815:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787360060.667834:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787360060.667858:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bcaa00 x1874182596042752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360060.667877:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596042752:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787360060.667904:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bca680 x1874182596042624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360060.667985:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596042624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787360061.561333:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360062.586499:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360062.713976:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596042880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360062.714043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360062.714139:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596042880 00000100:00100000:2.0:1787360062.714147:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596042880 00000100:00100000:2.0:1787360062.714190:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787360062.714198:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596042880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360062.714246:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360062.714334:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596042880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360062.714340:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787360062.714518:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596042880:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787360062.870204:0:13396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787360063.351528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360063.351571:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360063.351609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360063.351640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360063.351660:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360063.351692:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985088 00000100:00100000:0.0:1787360063.351703:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985088 00000100:00100000:0.0:1787360063.351754:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985344 00000100:00100000:0.0:1787360063.351768:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985344 00000100:00100000:0.0:1787360063.351783:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985216 00000100:00100000:0.0:1787360063.351786:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985216 00000100:00100000:0.0:1787360063.351797:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985472 00000100:00100000:0.0:1787360063.351800:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985472 00000100:00100000:0.0:1787360063.351814:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:0.0:1787360063.351824:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574985088:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360063.351868:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:3.0:1787360063.351876:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985344:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360063.351893:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574985088:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 70us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.351900:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:3.0:1787360063.351901:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985344:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360063.351906:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:3.0:1787360063.351916:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:3.0:1787360063.351922:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574985216:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360063.351944:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574985216:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.352009:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574984960 00000100:00100000:1.0:1787360063.352013:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574984960 00000100:00100000:1.0:1787360063.352044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 335 00000100:00100000:1.0:1787360063.352051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574984960:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360063.352077:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574984960:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.352083:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 335 00000100:00100000:0.0:1787360063.355980:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:0.0:1787360063.356004:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985472:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360063.356071:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985472:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 80us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.356079:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00080000:0.0:1787360063.359454:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360063.359464:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360063.364956:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 201 00010000:00010000:3.0:1787360063.611021:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360063.737780:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596043264:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.737848:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360063.737904:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596043776:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.737929:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360063.737950:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596044288:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.737968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360063.738317:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787360063.738325:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596043392:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.738372:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360063.738397:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596043904:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.738421:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360063.738435:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596044416:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.738453:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738536:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596043008:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738593:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596043520:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738613:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738625:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596044032:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738642:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738656:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596044544:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738685:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738700:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787360063.738706:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596043136:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738738:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738752:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596043648:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738781:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738840:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596044160:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.738860:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360063.738880:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043776 00000100:00100000:1.0:1787360063.738886:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043776 00000100:00100000:1.0:1787360063.738927:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044288 00000100:00100000:1.0:1787360063.738930:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044288 00000100:00100000:1.0:1787360063.738941:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043392 00000100:00100000:1.0:1787360063.738943:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043392 00000100:00100000:1.0:1787360063.738951:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043136 00000100:00100000:1.0:1787360063.738954:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043136 00000100:00100000:1.0:1787360063.738962:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043648 00000100:00100000:1.0:1787360063.738964:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043648 00000100:00100000:1.0:1787360063.738973:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044160 00000100:00100000:1.0:1787360063.738975:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044160 00000100:00100000:1.0:1787360063.739207:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787360063.739218:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596043776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739412:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596043776:12345-0@lo:400:kworker.0 Request processed in 195us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739420:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787360063.739437:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787360063.739444:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596044288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739469:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596044288:12345-0@lo:400:kworker.0 Request processed in 27us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739483:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787360063.739495:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787360063.739500:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596043392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739528:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596043392:12345-0@lo:400:kworker.0 Request processed in 28us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739533:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787360063.739543:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787360063.739548:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596043136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739576:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596043136:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739582:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787360063.739612:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596043136:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739636:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787360063.739642:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596043648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739671:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596043648:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739677:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787360063.739697:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596043648:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739714:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787360063.739720:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596044160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.739769:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596044160:12345-0@lo:400:kworker.0 Request processed in 37us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360063.739775:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787360063.739806:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596044160:0@lo:400:kworker.0 00000100:00100000:3.0:1787360063.739931:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043264 00000100:00100000:3.0:1787360063.739936:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043264 00000100:00100000:3.0:1787360063.739972:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043520 00000100:00100000:3.0:1787360063.739975:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043520 00000100:00100000:3.0:1787360063.740000:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787360063.740007:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596043264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360063.740042:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596043264:12345-0@lo:400:kworker.0 Request processed in 36us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360063.740048:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787360063.740060:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787360063.740065:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596043520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360063.740090:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596043520:12345-0@lo:400:kworker.0 Request processed in 25us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360063.740106:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787360063.740546:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043008 00000100:00100000:2.0:1787360063.740551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043008 00000100:00100000:2.0:1787360063.740592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787360063.740599:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596043008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.740633:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596043008:12345-0@lo:400:kworker.0 Request processed in 35us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360063.740640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1787360063.740682:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596043392:0@lo:400:kworker.0 00000100:00100000:2.0:1787360063.740695:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596043264:0@lo:400:kworker.0 00010000:00080000:2.0:1787360063.740708:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3dc00 x1874182596043776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360063.740730:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596043776:0@lo:400:kworker.0 00010000:00080000:2.0:1787360063.740742:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3e680 x1874182596044288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360063.740750:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596044288:0@lo:400:kworker.0 00000100:00100000:0.0:1787360063.740887:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596044672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360063.740927:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360063.740962:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596043904 00000100:00100000:0.0:1787360063.740966:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596043904 00000100:00100000:0.0:1787360063.740997:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044416 00000100:00100000:0.0:1787360063.741000:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044416 00000100:00100000:0.0:1787360063.741011:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044032 00000100:00100000:0.0:1787360063.741014:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044032 00000100:00100000:0.0:1787360063.741033:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044544 00000100:00100000:0.0:1787360063.741036:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044544 00000100:00100000:0.0:1787360063.741048:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787360063.741069:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596043904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360063.741108:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596043904:12345-0@lo:400:kworker.0 Request processed in 40us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.741124:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787360063.741135:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787360063.741140:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596044416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360063.741165:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596044416:12345-0@lo:400:kworker.0 Request processed in 25us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.741170:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787360063.741179:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787360063.741184:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596044032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360063.741206:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596044032:12345-0@lo:400:kworker.0 Request processed in 22us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.741212:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787360063.741220:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787360063.741714:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596044544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360063.741751:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596044544:12345-0@lo:400:kworker.0 Request processed in 525us (3066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.741768:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1787360063.741797:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360063.741801:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360063.741804:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360063.741806:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360063.741817:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044672 00000100:00100000:0.0:1787360063.741822:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044672 00000100:00100000:0.0:1787360063.741848:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787360063.741854:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596044672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360063.741874:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360063.741907:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596044672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.741912:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787360063.741930:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360063.741940:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596044800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360063.741968:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360063.741991:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044800 00000100:00100000:0.0:1787360063.741995:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044800 00000100:00100000:0.0:1787360063.742015:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360063.742020:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596044800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360063.742030:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360063.742057:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596044800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360063.742062:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1787360063.742091:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bcb480 x1874182596044800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787360063.743386:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3fb80 x1874182596043904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360063.743400:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596043904:0@lo:400:kworker.0 00010000:00080000:2.0:1787360063.743412:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3d500 x1874182596044416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360063.743420:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596044416:0@lo:400:kworker.0 00010000:00080000:2.0:1787360063.743483:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a0fc30a80 x1874182596044672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360063.743498:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596044672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360063.743596:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596044800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360063.743703:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596043008:0@lo:400:kworker.0 00000100:00100000:1.0:1787360063.743715:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596043520:0@lo:400:kworker.0 00010000:00080000:1.0:1787360063.743727:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3c000 x1874182596044032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360063.743735:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596044032:0@lo:400:kworker.0 00010000:00080000:1.0:1787360063.743964:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3d880 x1874182596044544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360063.743974:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596044544:0@lo:400:kworker.0 00010000:00010000:3.0:1787360064.634682:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360064.761689:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596044928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360064.761790:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360064.762451:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596044928 00000100:00100000:0.0:1787360064.762463:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596044928 00000100:00100000:0.0:1787360064.762528:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787360064.762541:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596044928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360064.762588:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787360064.762658:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596044928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360064.762665:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787360064.762934:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596044928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360065.658534:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360065.785676:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3b9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596045184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360065.785781:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360065.785888:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360065.785901:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596045056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360065.785929:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360065.786021:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045184 00000100:00100000:0.0:1787360065.786021:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045056 00000100:00100000:2.0:1787360065.786032:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045184 00000100:00100000:0.0:1787360065.786032:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045056 00000100:00100000:2.0:1787360065.786127:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787360065.786188:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360065.797183:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596045184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360065.797642:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360065.798071:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596045184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11930us (12286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360065.798096:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787360065.798134:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787360065.798167:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596045056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360065.798188:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360065.798220:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596045056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (12291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360065.798264:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1787360065.798653:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3b9b2a00 x1874182596045184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360065.798741:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3b9b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596045184:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787360065.798915:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bcb480 x1874182596045056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360065.798932:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596045056:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787360066.696503:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360067.706044:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360067.838955:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3b9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596045312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360067.839028:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360067.839187:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045312 00000100:00100000:2.0:1787360067.839195:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045312 00000100:00100000:2.0:1787360067.839272:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787360067.839282:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596045312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360067.839314:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360067.839367:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596045312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360067.839374:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787360067.839510:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3b9b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596045312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360068.464272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.464324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.464350:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.464385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.464410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.464458:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985856 00000100:00100000:2.0:1787360068.464471:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985856 00000100:00100000:2.0:1787360068.464544:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574986112 00000100:00100000:2.0:1787360068.464547:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574986112 00000100:00100000:1.0:1787360068.464671:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985728 00000100:00100000:1.0:1787360068.464676:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985728 00000100:00100000:1.0:1787360068.464699:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985984 00000100:00100000:1.0:1787360068.464702:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985984 00000100:00100000:1.0:1787360068.464732:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:1.0:1787360068.464743:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574985856:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360068.464834:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574985856:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 92us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360068.464843:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:1.0:1787360068.464861:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:1.0:1787360068.464868:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574985728:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360068.464917:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182574985728:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 49us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360068.464924:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:1.0:1787360068.464941:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:1.0:1787360068.464947:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985984:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360068.464970:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574985984:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360068.464975:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:2.0:1787360068.465105:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:2.0:1787360068.465114:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574986112:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360068.465141:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574986112:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.465159:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:0.0:1787360068.465340:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574985600 00000100:00100000:0.0:1787360068.465356:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574985600 00000100:00100000:0.0:1787360068.465433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 337 00000100:00100000:0.0:1787360068.465444:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574985600:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360068.465522:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574985600:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 77us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.465549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 337 00000100:00080000:3.0:1787360068.466062:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360068.466126:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1787360068.717878:0:13545:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:54:27 (1787360067) === 00010000:00010000:0.0:1787360068.730319:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360068.861605:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360068.861632:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596045440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360068.861697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360068.863814:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045440 00000100:00100000:0.0:1787360068.863828:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045440 00000100:00100000:0.0:1787360068.863890:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787360068.863901:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596045440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360068.863933:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360068.864007:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596045440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.864013:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787360068.864035:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787360068.864080:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903bc8700 x1874182596045440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360068.864099:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596045440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360068.864519:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a0fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596045568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360068.864558:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.864817:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045568 00000100:00100000:3.0:1787360068.864829:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045568 00000100:00100000:3.0:1787360068.864872:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787360068.864878:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596045568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360068.864889:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360068.864921:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596045568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360068.864926:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787360068.864985:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787360068.865006:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a0fc30700 x1874182596045568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360068.865020:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a0fc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596045568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360068.867369:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360068.867596:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596045824:0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.867659:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360068.867706:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360068.867726:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596045952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.867755:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360068.867788:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045824 00000100:00100000:0.0:1787360068.867795:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045824 00000100:00100000:0.0:1787360068.867840:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787360068.867849:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596045824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.867896:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596045824:12345-0@lo:400:kworker.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.867902:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787360068.867924:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045952 00000100:00100000:0.0:1787360068.867928:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045952 00000100:00100000:0.0:1787360068.867951:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787360068.867957:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596045952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.867988:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596045952:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.867994:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787360068.868031:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596045952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.868042:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596045824:0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870207:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596046080:0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870292:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.870330:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596045696:0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870357:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.870393:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046080 00000100:00100000:3.0:1787360068.870399:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046080 00000100:00100000:3.0:1787360068.870446:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787360068.870454:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870503:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596046080:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360068.870510:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787360068.870532:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596045696 00000100:00100000:3.0:1787360068.870536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596045696 00000100:00100000:3.0:1787360068.870562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787360068.870568:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596045696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870598:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596045696:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360068.870604:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1787360068.870711:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596046080:0@lo:400:kworker.0 00000100:00100000:3.0:1787360068.870731:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596045696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.876998:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596046464:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877065:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877110:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596046976:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877130:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877150:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787360068.877155:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596046336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877171:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877183:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596046848:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877199:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877254:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046464 00000100:00100000:2.0:1787360068.877261:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046464 00000100:00100000:2.0:1787360068.877311:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046976 00000100:00100000:2.0:1787360068.877315:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046976 00000100:00100000:2.0:1787360068.877328:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046336 00000100:00100000:2.0:1787360068.877331:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046336 00000100:00100000:2.0:1787360068.877344:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046848 00000100:00100000:2.0:1787360068.877346:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046848 00000100:00100000:2.0:1787360068.877360:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787360068.877368:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596046464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877418:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596046464:12345-0@lo:400:kworker.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.877425:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787360068.877441:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787360068.877447:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596046976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877474:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596046976:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.877492:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787360068.877505:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787360068.877510:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596046336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877538:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596046336:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.877543:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787360068.877553:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787360068.877559:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596046848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877583:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596046848:12345-0@lo:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.877588:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787360068.877610:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596046208:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877644:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877665:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596046720:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877687:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877705:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360068.877710:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596046592:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877728:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360068.877763:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596046336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.877773:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596046848:0@lo:400:kworker.0 00010000:00080000:2.0:1787360068.877783:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3fb80 x1874182596046464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360068.877793:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596046464:0@lo:400:kworker.0 00010000:00080000:2.0:1787360068.877809:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3f480 x1874182596046976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360068.877817:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596046976:0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.878345:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046208 00000100:00100000:0.0:1787360068.878351:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046208 00000100:00100000:0.0:1787360068.878392:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787360068.878401:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.878451:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596046208:12345-0@lo:400:kworker.0 Request processed in 51us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.878457:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787360068.878479:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046720 00000100:00100000:0.0:1787360068.878489:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046720 00000100:00100000:0.0:1787360068.878514:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596046592 00000100:00100000:0.0:1787360068.878517:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596046592 00000100:00100000:0.0:1787360068.878534:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787360068.878539:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596046720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.878568:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596046720:12345-0@lo:400:kworker.0 Request processed in 29us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.878574:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787360068.878584:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787360068.878589:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596046592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.878613:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596046592:12345-0@lo:400:kworker.0 Request processed in 24us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.878618:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787360068.878645:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360068.878649:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360068.878652:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787360068.879910:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3e680 x1874182596046592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360068.879926:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596046592:0@lo:400:kworker.0 00000100:00100000:2.0:1787360068.879939:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596046208:0@lo:400:kworker.0 00010000:00080000:2.0:1787360068.879951:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3dc00 x1874182596046720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360068.879959:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596046720:0@lo:400:kworker.0 00000100:00100000:0.0:1787360068.902041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360068.902100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360068.902135:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574986368 00000100:00100000:0.0:1787360068.902144:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574986368 00000100:00100000:0.0:1787360068.902194:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1787360068.902205:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1121de3d-8714-4863-bc5d-127112ba378a+6:10496:x1874182574986368:12345-192.168.206.11@tcp:700:mkdir.0 00000100:00100000:0.0:1787360068.902304:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1121de3d-8714-4863-bc5d-127112ba378a+6:10496:x1874182574986368:12345-192.168.206.11@tcp:700:mkdir.0 Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.902311:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:3.0:1787360068.902534:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574986240 00000100:00100000:3.0:1787360068.902538:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574986240 00000100:00100000:3.0:1787360068.902576:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:3.0:1787360068.902583:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574986240:12345-192.168.206.11@tcp:41:mkdir.0 00000004:00000024:3.0:1787360068.902609:0:11098:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360068.902666:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182574986240:12345-192.168.206.11@tcp:41:mkdir.0 Request processed in 83us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360068.902671:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360068.918639:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.918684:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574986624 00000100:00100000:2.0:1787360068.918693:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574986624 00000100:00100000:2.0:1787360068.918747:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:2.0:1787360068.918757:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:10496:x1874182574986624:12345-192.168.206.11@tcp:36:mkdir.0 00010000:00010000:2.0:1787360068.918806:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360068.918878:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee71ff99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef05 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.918896:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712b00) 00010000:00010000:2.0:1787360068.918906:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360068.918980:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919005:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919015:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919048:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919056:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919063:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919545:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919554:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919562:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360068.919574:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004df4d064 reply state 00000000fa11af45 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919583:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919589:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:2.0:1787360068.919598:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360068.919600:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787360068.919605:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360068.919612:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919618:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919625:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919630:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360068.919634:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919641:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919649:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ecfc00) 00010000:00010000:2.0:1787360068.919652:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360068.919655:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919662:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7200f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360068.919674:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004df4d064 reply state 00000000fa11af45 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919682:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.919697:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a28ecf700) 00010000:00010000:2.0:1787360068.919699:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360068.919701:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787360068.919772:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:10496:x1874182574986624:12345-192.168.206.11@tcp:36:mkdir.0 Request processed in 1015us (1141us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787360068.919780:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:2.0:1787360068.929064:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360068.929123:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574986752 00000100:00100000:2.0:1787360068.929132:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574986752 00000100:00100000:2.0:1787360068.929188:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360068.929199:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:10497:x1874182574986752:12345-192.168.206.11@tcp:101:chmod.0 00010000:00010000:2.0:1787360068.929220:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360068.930145:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee72010c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef98 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930593:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930608:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930621:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360068.930660:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787360068.930664:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360068.930700:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930740:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee72010c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef98 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930759:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef98 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360068.930767:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a07fdbf00) 00010000:00010000:2.0:1787360068.930769:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360068.930772:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041400, rc 0) 00000100:00100000:2.0:1787360068.930842:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:10497:x1874182574986752:12345-192.168.206.11@tcp:101:chmod.0 Request processed in 1645us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360068.930850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1787360068.943568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360068.943751:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987008 00000100:00100000:0.0:1787360068.943761:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987008 00000100:00100000:0.0:1787360068.943824:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1787360068.943849:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:10497:x1874182574987008:12345-192.168.206.11@tcp:36:chmod.0 00010000:00010000:0.0:1787360068.943901:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360068.943928:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef98 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.943949:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a07fdbf00) 00010000:00010000:0.0:1787360068.943960:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360068.943985:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.943999:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.944008:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360068.944203:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8850dc1 reply state 0000000068ddb98f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.944253:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.944260:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:0.0:1787360068.944262:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787360068.944265:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787360068.944272:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787360068.944343:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+9:10497:x1874182574987008:12345-192.168.206.11@tcp:36:chmod.0 Request processed in 497us (785us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787360068.944351:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:3.0:1787360068.980768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360068.980892:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987136 00000100:00100000:1.0:1787360068.980907:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987136 00000100:00100000:1.0:1787360068.980984:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:1.0:1787360068.980997:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+9:10498:x1874182574987136:12345-192.168.206.11@tcp:101:chown.0 00010000:00010000:1.0:1787360068.981028:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360068.981059:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eef9f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981156:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981174:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981188:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360068.981280:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360068.981294:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360068.981338:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981369:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef9f expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981387:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef9f expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.981397:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:1.0:1787360068.981400:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360068.981404:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:1.0:1787360068.981663:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+10:10498:x1874182574987136:12345-192.168.206.11@tcp:101:chown.0 Request processed in 667us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360068.981672:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:3.0:1787360068.997789:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360068.998360:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987264 00000100:00100000:1.0:1787360068.998377:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987264 00000100:00100000:1.0:1787360068.998945:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1787360068.998960:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+10:10498:x1874182574987264:12345-192.168.206.11@tcp:101:chown.0 00010000:00010000:1.0:1787360068.998986:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360068.999012:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee72012f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefa6 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999103:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999118:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999149:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999164:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999173:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999180:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999312:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999326:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360068.999333:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360068.999387:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360068.999391:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360069.000049:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000079:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000087:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000112:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000120:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360069.000125:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000135:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000151:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:1.0:1787360069.000155:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360069.000160:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000167:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000184:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000191:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000197:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000201:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360069.000204:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000219:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000501:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a28ecf700) 00010000:00010000:1.0:1787360069.000505:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360069.000508:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000514:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72013d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000558:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee72012f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefa6 expref: 12 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000574:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefa6 expref: 11 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.000582:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:1.0:1787360069.000584:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360069.000587:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70400, rc 0) 00000100:00100000:1.0:1787360069.000687:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+11:10498:x1874182574987264:12345-192.168.206.11@tcp:101:chown.0 Request processed in 1729us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360069.000697:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1787360069.006846:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.007026:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987392 00000100:00100000:2.0:1787360069.007044:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987392 00000100:00100000:2.0:1787360069.007148:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1787360069.007161:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1121de3d-8714-4863-bc5d-127112ba378a+11:10498:x1874182574987392:12345-192.168.206.11@tcp:900:chown.0 00000100:00100000:2.0:1787360069.007312:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1121de3d-8714-4863-bc5d-127112ba378a+11:10498:x1874182574987392:12345-192.168.206.11@tcp:900:chown.0 Request processed in 153us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360069.007322:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1787360069.009880:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.009973:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987648 00000100:00100000:0.0:1787360069.009996:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987648 00000100:00100000:0.0:1787360069.010054:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:0.0:1787360069.010064:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+11:10498:x1874182574987648:12345-192.168.206.11@tcp:36:chown.0 00010000:00010000:0.0:1787360069.010126:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360069.010152:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70400/0x359a4e2aee720144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefa6 expref: 11 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.010171:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:0.0:1787360069.010175:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360069.010196:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.010210:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.010279:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360069.023853:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1787360069.023936:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050e2bb7d reply state 000000000fe8ca80 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.023959:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.023969:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:0.0:1787360069.023972:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787360069.023977:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787360069.023989:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360069.024033:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024044:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024052:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024085:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.024090:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787360069.024092:0:6531:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1787360069.024101:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024114:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a28ecf700) 00010000:00010000:2.0:1787360069.024119:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360069.024119:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:10498:x1874182574987648:12345-192.168.206.11@tcp:36:chown.0 Request processed in 14050us (14242us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1787360069.024126:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024134:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7200fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360069.024145:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00010000:00010000:2.0:1787360069.024158:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024165:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024172:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024178:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.024181:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024187:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024212:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:2.0:1787360069.024215:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360069.024218:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024251:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720105 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024266:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024273:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024279:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024285:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.024288:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024294:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024303:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:2.0:1787360069.024305:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787360069.024309:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.024314:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72011a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.027979:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.027995:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.028017:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.028023:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360069.028027:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.028035:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.028052:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a28ecfa00) 00010000:00010000:1.0:1787360069.028054:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787360069.028059:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.028065:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689600/0x359a4e2aee72014b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360069.050314:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360069.050436:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574987776 00000100:00100000:1.0:1787360069.050447:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574987776 00000100:00100000:1.0:1787360069.050513:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787360069.050523:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:10499:x1874182574987776:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:1.0:1787360069.050547:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360069.050569:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefad expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360069.051865:0:6533:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1245us 00010000:00010000:0.0:1787360069.085438:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085462:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085474:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085491:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085498:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085504:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085627:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085637:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085644:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360069.085674:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787360069.085678:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360069.085716:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085740:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085747:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.085754:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086323:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360069.086328:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086337:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086349:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:0.0:1787360069.086352:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360069.086356:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086363:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086375:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086381:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086387:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086399:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360069.086403:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086408:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086416:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a08712f00) 00010000:00010000:0.0:1787360069.086418:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360069.086421:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086426:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720160 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086468:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefad expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086482:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefad expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.086490:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:0.0:1787360069.086492:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787360069.086494:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:0.0:1787360069.086565:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:10499:x1874182574987776:12345-192.168.206.11@tcp:101:touch.500 Request processed in 36042us (36258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.086573:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:3.0:1787360069.092842:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360069.092925:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988032 00000100:00100000:1.0:1787360069.092939:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988032 00000100:00100000:1.0:1787360069.093006:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:1.0:1787360069.093035:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+7:10499:x1874182574988032:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:1.0:1787360069.093058:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360069.093089:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72016e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefb4 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093206:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093480:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093494:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093556:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093565:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.093573:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360069.093977:0:11098:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787360069.094134:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094144:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094152:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094191:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094198:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094204:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094210:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360069.094214:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094221:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094713:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:1.0:1787360069.094716:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360069.094721:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094728:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720175 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360069.094742:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ab00487 reply state 000000008cfd2f75 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094763:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094771:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff998a28ed0d00) 00010000:00010000:1.0:1787360069.094781:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360069.094784:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787360069.094821:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72016e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefb4 expref: 10 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094834:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefb4 expref: 9 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.094841:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a28ed0e00) 00010000:00010000:1.0:1787360069.094843:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360069.094845:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360069.094919:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+10:10499:x1874182574988032:12345-192.168.206.11@tcp:101:touch.500 Request processed in 1888us (2091us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787360069.094928:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:2.0:1787360069.099836:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.099967:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988288 00000100:00100000:0.0:1787360069.099986:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988288 00000100:00100000:0.0:1787360069.100040:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:0.0:1787360069.100051:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+10:10499:x1874182574988288:12345-192.168.206.11@tcp:36:touch.500 00010000:00010000:0.0:1787360069.100112:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360069.100138:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefb4 expref: 10 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.100154:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a28ed0e00) 00010000:00010000:0.0:1787360069.100164:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360069.100214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.100261:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.100272:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360069.100370:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ff75df2 reply state 00000000022a82cc transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.100382:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.100387:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:0.0:1787360069.100390:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360069.100392:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360069.100473:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+11:10499:x1874182574988288:12345-192.168.206.11@tcp:36:touch.500 Request processed in 423us (646us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787360069.100480:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:3.0:1787360069.105768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.105915:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988416 00000100:00100000:0.0:1787360069.105925:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988416 00000100:00100000:0.0:1787360069.105981:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:0.0:1787360069.105992:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+11:10499:x1874182574988416:12345-192.168.206.11@tcp:101:touch.500 00010000:00010000:0.0:1787360069.106014:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360069.106032:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefbb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.106094:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefbb expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.106109:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefbb expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.106128:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:0.0:1787360069.106131:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360069.106135:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689c00, rc 0) 00000100:00100000:0.0:1787360069.106193:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+12:10499:x1874182574988416:12345-192.168.206.11@tcp:101:touch.500 Request processed in 203us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.106201:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:3.0:1787360069.112460:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.112537:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988544 00000100:00100000:0.0:1787360069.112548:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988544 00000100:00100000:0.0:1787360069.112605:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1787360069.112614:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1874182574988544:12345-192.168.206.11@tcp:8:touch.500 00010000:00080000:0.0:1787360069.112646:0:8448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1787360069.112676:0:8448:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee72019f 00002000:00100000:0.0:1787360069.112689:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1121de3d-8714-4863-bc5d-127112ba378a/ffff998a31314000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787360069.112717:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787360069.112796:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787360069.112835:0:8448:0:(import.c:65:import_set_state_nolock()) ffff998a31315800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360069.112902:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574988544:12345-192.168.206.11@tcp:8:touch.500 Request processed in 287us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.112910:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360069.126650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.126880:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988672 00000100:00100000:0.0:1787360069.126890:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988672 00000100:00100000:0.0:1787360069.126968:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1787360069.126978:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574988672:12345-192.168.206.11@tcp:2:touch.500 00000100:00080000:2.0:1787360069.127204:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787360069.129911:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1787360069.129926:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000100:00100000:0.0:1787360069.130292:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:0:x1874182574988672:12345-192.168.206.11@tcp:2:touch.500 Request processed in 3310us (3645us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787360069.130303:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:3.0:1787360069.133115:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.133261:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574988928 00000100:00100000:2.0:1787360069.133270:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574988928 00000100:00100000:2.0:1787360069.133332:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1787360069.133342:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+12:10499:x1874182574988928:12345-192.168.206.11@tcp:35:touch.500 00000100:00100000:2.0:1787360069.133925:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+13:10499:x1874182574988928:12345-192.168.206.11@tcp:35:touch.500 Request processed in 582us (814us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787360069.133936:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1787360069.155657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360069.155746:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574989056 00000100:00100000:1.0:1787360069.155756:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574989056 00000100:00100000:1.0:1787360069.155813:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1787360069.155835:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+13:10500:x1874182574989056:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:1.0:1787360069.155858:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360069.155876:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee7201a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefc2 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.155936:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.155950:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.155974:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360069.156031:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360069.156035:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360069.156087:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.156115:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee7201a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefc2 expref: 15 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.156134:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefc2 expref: 14 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360069.156154:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:1.0:1787360069.156157:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360069.156160:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71400, rc 0) 00000100:00100000:1.0:1787360069.156275:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+14:10500:x1874182574989056:12345-192.168.206.11@tcp:101:rm.0 Request processed in 453us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360069.156283:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1787360069.166408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.167208:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574989312 00000100:00100000:2.0:1787360069.167220:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574989312 00000100:00100000:2.0:1787360069.167313:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:2.0:1787360069.167326:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:10500:x1874182574989312:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:2.0:1787360069.167347:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360069.167367:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefc9 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360069.167473:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360069.167793:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefc9 expref: 16 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.167826:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:2.0:1787360069.167830:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360069.167835:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefc9 expref: 16 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.167849:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:2.0:1787360069.168175:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+15:10500:x1874182574989312:12345-192.168.206.11@tcp:101:rm.0 Request processed in 851us (1774us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1787360069.168184:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:2.0:1787360069.187939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360069.188042:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574989440 00000100:00100000:1.0:1787360069.188052:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574989440 00000100:00100000:1.0:1787360069.188117:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1787360069.188126:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:10500:x1874182574989440:12345-192.168.206.11@tcp:37:rm.0 00000100:00100000:1.0:1787360069.199173:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:10500:x1874182574989440:12345-192.168.206.11@tcp:37:rm.0 Request processed in 11039us (11236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360069.199185:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360069.210532:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.210651:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574989696 00000100:00100000:2.0:1787360069.210662:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574989696 00000100:00100000:2.0:1787360069.210719:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1787360069.210729:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20565450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+15:10500:x1874182574989696:12345-192.168.206.11@tcp:35:rm.0 00000100:00100000:2.0:1787360069.211179:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20565450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+16:10500:x1874182574989696:12345-192.168.206.11@tcp:35:rm.0 Request processed in 449us (656us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787360069.211187:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1787360069.215421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360069.215512:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574989952 00000100:00100000:3.0:1787360069.215529:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574989952 00000100:00100000:3.0:1787360069.216031:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787360069.216771:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+16:10500:x1874182574989952:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:2.0:1787360069.216802:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360069.216825:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefd0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.216941:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7201c9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.216970:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7201c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.216982:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7201c9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360069.216994:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360069.217141:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd0 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.217162:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7201c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd0 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.217172:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:2.0:1787360069.217174:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360069.217177:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:2.0:1787360069.217367:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574989952:12345-192.168.206.11@tcp:101:rm.0 Request processed in 1323us (1968us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787360069.217376:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1787360069.227391:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360069.227527:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574990080 00000100:00100000:0.0:1787360069.227541:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574990080 00000100:00100000:0.0:1787360069.227689:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:0.0:1787360069.227821:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990080:12345-192.168.206.11@tcp:41:rm.0 00000004:00000024:0.0:1787360069.227909:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787360069.228127:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990080:12345-192.168.206.11@tcp:41:rm.0 Request processed in 423us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.228137:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:0.0:1787360069.232375:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.232455:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574990208 00000100:00100000:2.0:1787360069.232471:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574990208 00000100:00100000:2.0:1787360069.232542:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:2.0:1787360069.232553:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990208:12345-192.168.206.11@tcp:101:rm.0 00010000:00010000:2.0:1787360069.232574:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360069.232597:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefd7 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232679:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232693:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232705:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232716:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232723:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232730:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232809:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232819:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.232826:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360069.232857:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787360069.232862:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360069.232877:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233024:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233033:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233040:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233047:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233053:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.233058:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233075:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233088:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:2.0:1787360069.233091:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360069.233095:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233101:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee7201de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233114:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233121:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233133:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233138:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.233141:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233148:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233157:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff998a28ed0d00) 00010000:00010000:2.0:1787360069.233159:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360069.233162:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233167:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7201e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233191:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7201d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd7 expref: 20 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233205:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd7 expref: 19 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.233213:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:2.0:1787360069.233215:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360069.233218:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:2.0:1787360069.233325:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+19:10500:x1874182574990208:12345-192.168.206.11@tcp:101:rm.0 Request processed in 774us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360069.233344:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:1.0:1787360069.244398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.244504:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574990464 00000100:00100000:2.0:1787360069.244520:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574990464 00000100:00100000:2.0:1787360069.244587:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:2.0:1787360069.244599:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:10500:x1874182574990464:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:2.0:1787360069.244647:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787360069.244674:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7201ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd7 expref: 19 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244696:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefbb expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244708:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:2.0:1787360069.244730:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee7201ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefc2 expref: 17 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244739:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:2.0:1787360069.244742:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360069.244766:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244779:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244789:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244800:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244822:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244830:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244937:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244947:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.244955:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360069.245177:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787360069.245187:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347491960219ns, next at 348491958225ns, rc = 0 00010000:00010000:2.0:1787360069.245263:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245273:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245282:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245289:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245296:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245312:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245336:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360069.245360:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245365:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245371:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245378:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.245382:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245390:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245400:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:2.0:1787360069.245402:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787360069.245406:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245411:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720201 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245427:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245433:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245460:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245466:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.245469:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245480:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245489:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:2.0:1787360069.245491:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360069.245494:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245499:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7201f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360069.245509:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d28dee55 reply state 00000000a3513575 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245518:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.245524:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff998a28ed0d00) 00010000:00010000:2.0:1787360069.245526:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360069.245528:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360069.245612:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990464:12345-192.168.206.11@tcp:36:rm.0 Request processed in 1014us (1229us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787360069.245620:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00010000:00010000:3.0:1787360069.248390:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360069.248410:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360069.248424:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360069.248449:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360069.248462:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360069.248488:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00000100:00100000:1.0:1787360069.248488:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00010000:00010000:3.0:1787360069.248498:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787360069.248503:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360069.248510:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee720208 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360069.248535:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360069.248538:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360069.248540:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360069.249086:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574990720 00000100:00100000:2.0:1787360069.249096:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574990720 00000100:00100000:2.0:1787360069.249152:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360069.249162:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990720:12345-192.168.206.11@tcp:35:rm.0 00000100:00100000:2.0:1787360069.249526:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+19:10500:x1874182574990720:12345-192.168.206.11@tcp:35:rm.0 Request processed in 363us (1047us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787360069.249535:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1787360069.254798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360069.255407:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574990976 00000100:00100000:2.0:1787360069.255418:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574990976 00000100:00100000:2.0:1787360069.255476:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:2.0:1787360069.255487:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+19:10500:x1874182574990976:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:2.0:1787360069.255543:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787360069.255573:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7201c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefd0 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255595:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee720167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefad expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255607:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a08712500) 00010000:00010000:2.0:1787360069.255621:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef9f expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255629:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712400) 00010000:00010000:2.0:1787360069.255635:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360069.255658:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255670:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255693:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255707:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255726:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255732:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255804:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255813:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.255819:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360069.256147:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787360069.256161:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256168:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256176:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256181:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.256191:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256199:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256209:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff998a3d37bc00) 00010000:00010000:2.0:1787360069.256212:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787360069.256216:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256222:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee72021d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256276:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256283:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256289:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256296:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360069.256299:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256305:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256312:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a3d37b600) 00010000:00010000:2.0:1787360069.256314:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360069.256456:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256464:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee72020f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360069.256478:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034455ae5 reply state 00000000ff87a093 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256489:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360069.256496:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a3d37be00) 00010000:00010000:2.0:1787360069.256498:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360069.256501:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360069.256570:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:10500:x1874182574990976:12345-192.168.206.11@tcp:36:rm.0 Request processed in 1084us (1780us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787360069.256578:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00010000:00010000:3.0:1787360069.757104:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360069.882729:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596047104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360069.882799:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360069.882917:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047104 00000100:00100000:2.0:1787360069.882926:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047104 00000100:00100000:2.0:1787360069.882977:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787360069.882987:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596047104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360069.883020:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1787360069.885812:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596047104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2817us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360069.885827:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787360069.887980:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596047104:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360070.790157:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360070.905399:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360070.905425:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596047232:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1787360070.905448:0:8769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349152219731ns, next at 350152214556ns, rc = 0 00000100:00100000:2.0:1787360070.905490:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596047360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360070.905577:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360070.905831:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047360 00000100:00100000:1.0:1787360070.905842:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047360 00000100:00100000:1.0:1787360070.905918:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787360070.905931:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596047360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360070.905965:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360070.906018:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596047360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360070.906026:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1787360070.906094:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb7100 x1874182596047360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360070.906096:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360070.906128:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596047360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360070.906165:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047232 00000100:00100000:1.0:1787360070.906170:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047232 00000100:00100000:1.0:1787360070.906202:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360070.906211:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596047232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360070.906222:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360070.906301:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596047232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360070.906307:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1787360070.906608:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3fedc700 x1874182596047232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360070.906633:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596047232:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360070.908622:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360071.802809:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360072.825375:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360072.954216:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360072.954259:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596047488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360072.954326:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360072.954444:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047488 00000100:00100000:3.0:1787360072.954452:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047488 00000100:00100000:3.0:1787360072.954500:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787360072.954509:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596047488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360072.954540:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360072.954588:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596047488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360072.954610:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787360072.954881:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596047488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360073.591640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594616:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360073.594748:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991360 00000100:00100000:3.0:1787360073.594760:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991360 00000100:00100000:3.0:1787360073.594823:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991616 00000100:00100000:3.0:1787360073.594827:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991616 00000100:00100000:3.0:1787360073.594843:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991232 00000100:00100000:3.0:1787360073.594845:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991232 00000100:00100000:3.0:1787360073.594859:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991744 00000100:00100000:3.0:1787360073.594861:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991744 00000100:00100000:3.0:1787360073.594880:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:3.0:1787360073.594892:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574991360:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360073.594984:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574991360:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 94us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.594993:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:3.0:1787360073.595012:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:3.0:1787360073.595020:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574991616:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360073.595058:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574991616:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.595065:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:3.0:1787360073.595078:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:3.0:1787360073.595109:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:2401:x1874182574991232:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360073.595140:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:2401:x1874182574991232:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.595147:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:3.0:1787360073.595159:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:3.0:1787360073.595165:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574991744:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360073.595188:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574991744:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.595194:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:3.0:1787360073.595219:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991488 00000100:00100000:3.0:1787360073.595247:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991488 00000100:00100000:3.0:1787360073.595278:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1787360073.595285:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574991488:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360073.595313:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574991488:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.595320:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00080000:2.0:1787360073.596213:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360073.596222:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360073.596252:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360073.598942:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991104 00000100:00100000:0.0:1787360073.598962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991104 00000100:00100000:0.0:1787360073.600040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 339 00000100:00100000:0.0:1787360073.600071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574991104:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360073.600183:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574991104:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 119us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360073.600192:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 339 00010000:00010000:0.0:1787360073.850658:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360073.978936:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596047616:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.978949:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596047744:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.980446:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596047872:0@lo:400:kworker.0 00000100:00100000:0.0:1787360073.982270:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360073.982414:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596048128:0@lo:400:kworker.0 00000100:00100000:0.0:1787360073.982454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360073.982481:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596048640:0@lo:400:kworker.0 00000100:00100000:0.0:1787360073.982513:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360073.982528:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360073.982628:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596049152:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.985712:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.985768:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596048384:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.985834:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.985856:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596048896:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.985881:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.985912:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787360073.985920:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596048000:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.985954:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.985977:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596048512:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986004:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.986025:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596049024:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986057:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.986156:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047616 00000100:00100000:3.0:1787360073.986169:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047616 00000100:00100000:3.0:1787360073.986244:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787360073.986256:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596047616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986310:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596047616:12345-0@lo:400:kworker.0 Request processed in 56us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986318:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787360073.986356:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047744 00000100:00100000:3.0:1787360073.986361:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047744 00000100:00100000:3.0:1787360073.986386:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048384 00000100:00100000:3.0:1787360073.986389:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048384 00000100:00100000:3.0:1787360073.986415:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048896 00000100:00100000:3.0:1787360073.986417:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048896 00000100:00100000:3.0:1787360073.986432:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048000 00000100:00100000:3.0:1787360073.986435:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048000 00000100:00100000:3.0:1787360073.986449:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787360073.986456:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596047744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986492:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596047744:12345-0@lo:400:kworker.0 Request processed in 37us (3967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986499:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787360073.986510:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787360073.986516:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596048384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986574:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596048384:12345-0@lo:400:kworker.0 Request processed in 58us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986580:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787360073.986592:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787360073.986599:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596048896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986624:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596048896:12345-0@lo:400:kworker.0 Request processed in 26us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986630:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787360073.986641:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787360073.986649:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596048000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986675:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596048000:12345-0@lo:400:kworker.0 Request processed in 28us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986680:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787360073.986699:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048128 00000100:00100000:3.0:1787360073.986703:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048128 00000100:00100000:3.0:1787360073.986726:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596047872 00000100:00100000:3.0:1787360073.986729:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596047872 00000100:00100000:3.0:1787360073.986740:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787360073.986745:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986777:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596048128:12345-0@lo:400:kworker.0 Request processed in 32us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986783:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787360073.986794:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787360073.986799:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596047872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986826:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596047872:12345-0@lo:400:kworker.0 Request processed in 27us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986840:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787360073.986871:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048640 00000100:00100000:3.0:1787360073.986876:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048640 00000100:00100000:3.0:1787360073.986904:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048512 00000100:00100000:3.0:1787360073.986908:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048512 00000100:00100000:3.0:1787360073.986921:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049024 00000100:00100000:3.0:1787360073.986923:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049024 00000100:00100000:3.0:1787360073.986936:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787360073.986942:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596048640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.986973:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35368c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596048640:12345-0@lo:400:kworker.0 Request processed in 32us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.986979:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787360073.987176:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596047744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.987189:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596048256:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.987221:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360073.987258:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596048768:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.987283:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360073.987314:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360073.987339:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.987560:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787360073.987577:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596048512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.987786:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596048512:12345-0@lo:400:kworker.0 Request processed in 213us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.987795:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787360073.987816:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787360073.987824:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596049024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.987853:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596049024:12345-0@lo:400:kworker.0 Request processed in 31us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.987859:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787360073.987895:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048256 00000100:00100000:3.0:1787360073.987902:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048256 00000100:00100000:3.0:1787360073.987945:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596048768 00000100:00100000:3.0:1787360073.987949:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596048768 00000100:00100000:3.0:1787360073.987969:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787360073.988455:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596048256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.988500:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596048256:12345-0@lo:400:kworker.0 Request processed in 511us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.988507:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787360073.988522:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787360073.988529:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596048768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.988556:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596048768:12345-0@lo:400:kworker.0 Request processed in 29us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.988563:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1787360073.988581:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360073.988585:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360073.988588:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360073.988591:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360073.988661:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596048000:0@lo:400:kworker.0 00010000:00080000:3.0:1787360073.988677:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb7b80 x1874182596048512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360073.988688:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596048512:0@lo:400:kworker.0 00010000:00080000:3.0:1787360073.988701:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb4380 x1874182596049024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360073.988710:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596049024:0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.988726:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596047872:0@lo:400:kworker.0 00010000:00080000:3.0:1787360073.988739:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb6300 x1874182596048384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360073.988746:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596048384:0@lo:400:kworker.0 00010000:00080000:3.0:1787360073.988775:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb7800 x1874182596048896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360073.988783:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596048896:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.989003:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596048256:0@lo:400:kworker.0 00000100:00100000:2.0:1787360073.989020:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596048768:0@lo:400:kworker.0 00000001:02000400:1.0:1787360073.989435:0:13693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1787360073.989887:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360073.989905:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596049408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360073.989969:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360073.990082:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049280 00000100:00100000:0.0:1787360073.990090:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049280 00000100:00100000:0.0:1787360073.990131:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049408 00000100:00100000:0.0:1787360073.990133:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049408 00000100:00100000:0.0:1787360073.990187:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787360073.990200:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596049280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360073.990268:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360073.990329:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596049280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360073.990336:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787360073.990359:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787360073.990373:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596049408:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787360073.990376:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510f800 x1874182596049280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1787360073.990387:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360073.990407:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360073.990433:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596049408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360073.990453:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1787360073.990539:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb4a80 x1874182596049408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360073.990559:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596049408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360073.990602:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.990630:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049152 00000100:00100000:3.0:1787360073.990638:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049152 00000100:00100000:0.0:1787360073.990642:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596047616:0@lo:400:kworker.0 00000100:00100000:0.0:1787360073.990661:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596048128:0@lo:400:kworker.0 00010000:00080000:0.0:1787360073.990681:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb4e00 x1874182596048640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360073.990693:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787360073.990694:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596048640:0@lo:400:kworker.0 00000100:00080000:2.0:1787360073.990932:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360073.991321:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596049152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360073.991409:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596049152:12345-0@lo:400:kworker.0 Request processed in 94us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360073.991418:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1787360073.991589:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb6d80 x1874182596049152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360073.991604:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596049152:0@lo:400:kworker.0 00000004:00080000:2.0:1787360074.493590:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787360074.493647:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787360074.493658:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787360074.493796:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493842:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493851:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493859:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360074.493865:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493874:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493895:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff998a28ed0d00) 00010000:00010000:2.0:1787360074.493898:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360074.493904:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493910:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee72017c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493933:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493939:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493945:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493951:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360074.493961:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493968:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493977:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff998a08712f00) 00010000:00010000:2.0:1787360074.493980:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360074.493983:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.493989:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee720191 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494009:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494015:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494020:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494026:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360074.494029:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494034:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494054:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x29b0d755 (ffff998a28ed0d00) 00010000:00010000:2.0:1787360074.494057:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360074.494067:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494073:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee7201fa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x29b0d755 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494093:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494098:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494104:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494109:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360074.494113:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494119:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494126:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff998a3d37be00) 00010000:00010000:2.0:1787360074.494128:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360074.494131:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360074.494136:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee720216 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360074.494375:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360074.494397:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596049536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787360074.494494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360074.494578:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049536 00000100:00100000:1.0:1787360074.494587:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049536 00000100:00100000:1.0:1787360074.494639:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360074.494648:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596049536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787360074.494679:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1787360074.494727:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a88f345, atime: 0x6a88f345, ctime: 0x6a88f345, blocks: 0x0 00010000:00010000:1.0:1787360074.494735:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.494754:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1787360074.494759:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360074.494767:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.494784:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.494794:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.494801:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.494820:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360074.495010:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596049536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 360us (514us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787360074.495027:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787360074.495067:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360074.495074:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.495082:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360074.495086:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.495095:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.495110:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.495118:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720224 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360074.495136:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360074.495138:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360074.495140:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787360074.495172:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998903b3d500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787360074.495177:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596049536:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787360074.873669:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360075.006437:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596049664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360075.006504:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360075.006671:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049664 00000100:00100000:3.0:1787360075.006679:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049664 00000100:00100000:3.0:1787360075.006725:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787360075.006734:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596049664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360075.006766:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787360075.008819:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596049664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2078us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360075.008833:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787360075.008925:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596049664:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1787360075.039625:0:13741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4d8b2510 20000000:00000080:0.0:1787360075.039643:0:13741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998904130800 uarg=0000000000000000 20000000:01000000:0.0:1787360075.039680:0:13741:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787360075.039687:0:13741:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787360075.039692:0:13741:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787360075.040061:0:13742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787360075.040337:0:13741:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787360075.046635:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787360075.046682:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787360075.046699:0:13741:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787360075.046717:0:13741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787360075.046737:0:13741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046756:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046764:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046772:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046780:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046787:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200db expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046794:0:13741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046818:0:13741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046861:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.046875:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 23 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.046889:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596049792:0@lo:104: 00000100:00100000:0.0:1787360075.046952:0:13741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787360075.047015:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.047023:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 23 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.047031:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596049920:0@lo:104: 00010000:00010000:0.0:1787360075.047069:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.047077:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 23 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.047084:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050048:0@lo:104: 00010000:00010000:0.0:1787360075.047108:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.047115:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 23 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.047130:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050176:0@lo:104: 00010000:00010000:0.0:1787360075.047580:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.047592:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.047787:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050304:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360075.047933:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787360075.047956:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360075.047981:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360075.048002:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360075.048011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049792 00000100:00100000:3.0:1787360075.048017:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049792 00000100:00100000:3.0:1787360075.048074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596049920 00000100:00100000:3.0:1787360075.048077:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596049920 00000100:00100000:3.0:1787360075.048087:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050048 00000100:00100000:3.0:1787360075.048089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050048 00000100:00100000:3.0:1787360075.048099:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050176 00000100:00100000:3.0:1787360075.048101:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050176 00000100:00100000:3.0:1787360075.048113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360075.048121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:13741:x1874182596049792:12345-0@lo:104: 00010000:00010000:3.0:1787360075.048133:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.048188:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360075.048195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+6:13741:x1874182596049792:12345-0@lo:104: Request processed in 74us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360075.048202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360075.048257:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787360075.048264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:13741:x1874182596049920:12345-0@lo:104: 00010000:00010000:3.0:1787360075.048271:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.048303:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787360075.048308:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+5:13741:x1874182596049920:12345-0@lo:104: Request processed in 45us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360075.048313:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787360075.048326:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360075.048332:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13741:x1874182596050048:12345-0@lo:104: 00010000:00010000:3.0:1787360075.048347:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.048380:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787360075.048385:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+4:13741:x1874182596050048:12345-0@lo:104: Request processed in 54us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360075.048391:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360075.048403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787360075.048421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13741:x1874182596050176:12345-0@lo:104: 00010000:00010000:3.0:1787360075.048428:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.048554:0:13741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.048565:0:13741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.048574:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050432:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360075.048605:0:13741:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360075.048624:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596049792:0@lo:104: 00000100:00100000:0.0:1787360075.048632:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596049920:0@lo:104: 00000100:00100000:0.0:1787360075.048638:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050048:0@lo:104: 00010000:00010000:1.0:1787360075.048975:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787360075.048982:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049001:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aa400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360075.049004:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049012:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360075.049019:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360075.049024:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360075.049069:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049075:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360075.049095:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049102:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a350aa400/0x359a4e2aee7200e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200f0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049115:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360075.049118:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049125:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aba00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360075.049127:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049144:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360075.049150:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360075.049155:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360075.049179:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049185:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360075.049200:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049206:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a350aba00/0x359a4e2aee7200db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200e2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049214:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360075.049217:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049222:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360075.049244:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049251:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360075.049257:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360075.049268:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360075.049283:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049289:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360075.049295:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049301:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689800/0x359a4e2aee7200cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200d4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049311:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360075.049312:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360075.049314:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360075.049327:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596050560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.049362:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360075.049401:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596050688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.049445:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360075.049466:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360075.049471:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596050816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.049492:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360075.049520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050560 00000100:00100000:1.0:1787360075.049525:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050560 00010000:00010000:1.0:1787360075.049548:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 24 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.049571:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050688 00000100:00100000:1.0:1787360075.049574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050688 00010000:00010000:1.0:1787360075.049594:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 25 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.049605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050816 00000100:00100000:1.0:1787360075.049607:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050816 00010000:00010000:1.0:1787360075.049616:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 26 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.049628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360075.049634:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+26:3661:x1874182596050560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.049646:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360075.049651:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 26 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049662:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 26 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049674:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688600/0x359a4e2aee7200f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7200e9 expref: 26 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049686:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360075.049716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+25:3661:x1874182596050560:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360075.049722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360075.049736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787360075.049741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596050688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.049748:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360075.049751:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 24 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049768:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 24 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049777:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040600/0x359a4e2aee7200e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7200db expref: 24 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049785:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360075.049811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3658:x1874182596050688:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360075.049816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787360075.049828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787360075.049833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3658:x1874182596050816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.049839:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360075.049844:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 22 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049851:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 22 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049859:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70200/0x359a4e2aee7200d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7200cd expref: 22 pid: 6524 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.049867:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360075.049888:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182596050816:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360075.049893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787360075.049928:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596050560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.049953:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596050816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.049968:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596050688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360075.050277:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360075.050285:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+3:13741:x1874182596050176:12345-0@lo:104: Request processed in 1864us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360075.050292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1787360075.050312:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360075.050317:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.050324:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360075.050327:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.050335:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360075.050342:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360075.050356:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360075.050375:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.050380:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360075.050392:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360075.050398:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee7200bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7200c6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.050554:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596050944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360075.050583:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360075.050615:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360075.050623:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596050944 00000100:00100000:1.0:1787360075.050628:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596050944 00010000:00010000:1.0:1787360075.050646:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 21 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.050668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360075.050674:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182596050944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.050682:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360075.050686:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 21 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.050696:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 21 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.050707:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360075.050735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182596050944:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360075.050740:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360075.050767:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596050944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.050799:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041800/0x359a4e2aee7200c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7200bf expref: 20 pid: 6526 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.050809:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050176:0@lo:104: 00010000:00010000:3.0:1787360075.050859:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360075.050861:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360075.050863:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360075.050870:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360075.055057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360075.055300:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050304:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360075.055313:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13741:1874182596050432:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360075.055348:0:13741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.055653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574991872 00000100:00100000:0.0:1787360075.055660:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574991872 00010000:00010000:0.0:1787360075.055703:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360075.055739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360075.055749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574991872:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360075.055776:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360075.055783:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.055795:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.055812:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040a00/0x359a4e2aee7200b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef91 expref: 13 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360075.055826:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360075.055883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:2399:x1874182574991872:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 135us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360075.055890:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1787360075.056128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360075.056184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992000 00000100:00100000:1.0:1787360075.056189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992000 00010000:00010000:1.0:1787360075.056217:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360075.056263:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1787360075.056271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:2399:x1874182574992000:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360075.056280:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360075.056284:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056293:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056304:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71800/0x359a4e2aee7200b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef8a expref: 12 pid: 6525 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056316:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056336:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056350:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056356:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056362:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056368:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360075.056372:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056380:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056393:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056401:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360075.056434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:2399:x1874182574992000:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 164us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360075.056440:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00010000:00010000:1.0:1787360075.056462:0:13741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056469:0:13741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.056476:0:13741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689200/0x359a4e2aee72022b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360075.898375:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787360076.007142:0:13790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc906787a0 20000000:00000080:3.0:1787360076.007166:0:13790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9989039e1400 uarg=0000000000000000 20000000:01000000:3.0:1787360076.007405:0:13790:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787360076.007414:0:13790:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1787360076.007420:0:13790:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1787360076.007874:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787360076.008078:0:13790:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1787360076.008163:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1787360076.008194:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1787360076.008212:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1787360076.008612:0:13790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787360076.008640:0:13790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008676:0:13790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008689:0:13790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008697:0:13790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008704:0:13790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008712:0:13790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008719:0:13790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360076.008724:0:13790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008734:0:13790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008750:0:13790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008759:0:13790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.008766:0:13790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350ab000/0x359a4e2aee720232 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360076.026418:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360076.026447:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596051072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360076.026605:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.026753:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051072 00000100:00100000:0.0:1787360076.026763:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051072 00000100:00100000:0.0:1787360076.026846:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360076.026857:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596051072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360076.026889:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360076.026939:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596051072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.026947:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360076.026998:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596051072:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360076.027165:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360076.027644:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360076.027658:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596051200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360076.027829:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.027865:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051200 00000100:00100000:0.0:1787360076.027871:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051200 00000100:00100000:0.0:1787360076.027913:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787360076.027922:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596051200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360076.027939:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360076.027974:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596051200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.027980:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787360076.028018:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596051200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787360076.028046:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787360076.281788:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787360076.281798:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998902639800 from 7 10000000:01000000:0.0:1787360076.281804:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360076.281862:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.281875:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.281888:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360076.281917:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.281997:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.282073:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a182436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.282249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051328 00000100:00100000:2.0:1787360076.282260:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051328 00000100:00100000:2.0:1787360076.282322:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787360076.282333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:6528:x1874182596051328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360076.282349:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360076.282367:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a35040000/0x359a4e2aee720240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720239 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.282394:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a35040000/0x359a4e2aee720240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720239 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.282405:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a35040000/0x359a4e2aee720240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720239 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.282416:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040000, rc 0) 00000100:00100000:2.0:1787360076.282461:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.282467:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787360076.282596:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360076.282614:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360076.282623:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360076.282838:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.282870:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.282901:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360076.283072:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051456 00000100:00100000:0.0:1787360076.283078:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051456 00000100:00100000:0.0:1787360076.283116:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1787360076.283124:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.283266:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.283273:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787360076.284307:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.284370:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.284447:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.284485:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360076.284756:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051584 00000100:00100000:3.0:1787360076.284764:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051584 00000100:00100000:3.0:1787360076.284851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787360076.284862:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360076.284982:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.284989:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787360076.285137:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.285402:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13803:1874182596051712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360076.285443:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.285949:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.286015:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051712 00000100:00100000:2.0:1787360076.286037:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051712 00000100:00100000:2.0:1787360076.286076:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787360076.286084:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:13803:x1874182596051712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.286219:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:13803:x1874182596051712:12345-0@lo:502:llog_process_th.0 Request processed in 135us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.286244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787360076.286351:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13803:1874182596051712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787360076.286381:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360076.286393:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360076.286396:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360076.286404:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998902639800 00000020:00000080:1.0:1787360076.286415:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360076.286491:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360076.286495:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360076.286496:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360076.286499:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360076.286501:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360076.286503:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787360076.286506:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998902639800 00000020:00000080:1.0:1787360076.286508:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787360076.286564:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13803:1874182596051840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360076.286604:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.286628:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360076.291628:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051840 00000100:00100000:3.0:1787360076.291648:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051840 00000100:00100000:3.0:1787360076.291776:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787360076.291788:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:13803:x1874182596051840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360076.291999:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:13803:x1874182596051840:12345-0@lo:502:llog_process_th.0 Request processed in 213us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.292008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1787360076.292301:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13803:1874182596051840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787360076.292345:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360076.292354:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360076.292357:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787360076.292363:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787360076.293147:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787360076.293177:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360076.293190:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.293203:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360076.293216:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360076.293219:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61e800 from 7 10000000:01000000:3.0:1787360076.293237:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360076.293281:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.293302:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.293314:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360076.293341:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360076.293410:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360076.293457:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360076.293482:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596051968 00000100:00100000:3.0:1787360076.293489:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596051968 00000100:00100000:3.0:1787360076.294644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787360076.294662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:6528:x1874182596051968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360076.294947:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360076.294969:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350aa800/0x359a4e2aee72024e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720247 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.295001:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350aa800/0x359a4e2aee72024e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720247 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.295012:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350aa800/0x359a4e2aee72024e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720247 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.295028:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aa800, rc 0) 00000100:00100000:3.0:1787360076.295120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596051968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 464us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.295127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787360076.295262:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596051968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360076.295285:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.295598:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360076.296599:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.296673:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.296798:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787360076.298656:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052096 00000100:00100000:3.0:1787360076.298672:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052096 00000100:00100000:3.0:1787360076.298813:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787360076.298825:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596052096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360076.299218:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596052096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.299243:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787360076.300498:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.302926:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.303068:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.303129:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989010d7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.303634:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052224 00000100:00100000:2.0:1787360076.303645:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052224 00000100:00100000:2.0:1787360076.303780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787360076.303792:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596052224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.303948:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596052224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.303957:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787360076.305175:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.311859:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13805:1874182596052352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.311967:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.312043:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360076.312161:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052352 00000100:00100000:0.0:1787360076.312171:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052352 00000100:00100000:0.0:1787360076.312254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787360076.312267:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:13805:x1874182596052352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360076.312419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:13805:x1874182596052352:12345-0@lo:502:llog_process_th.0 Request processed in 154us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.312434:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787360076.312560:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13805:1874182596052352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360076.312596:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360076.312609:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.312612:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787360076.312619:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3d61e800 00000020:00000080:2.0:1787360076.312623:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787360076.312817:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360076.312822:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.312823:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787360076.312826:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360076.312829:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.312831:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787360076.312834:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3d61e800 00000020:00000080:2.0:1787360076.312837:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787360076.312882:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13805:1874182596052480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.312927:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.312966:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052480 00000100:00100000:2.0:1787360076.312971:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052480 00000100:00100000:2.0:1787360076.313000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787360076.313008:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:13805:x1874182596052480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.313100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:13805:x1874182596052480:12345-0@lo:502:llog_process_th.0 Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.313107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787360076.313146:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.313160:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13805:1874182596052480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360076.313178:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360076.313182:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.313184:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787360076.313187:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787360076.314212:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1787360076.314309:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360076.314323:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.314336:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360076.314349:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787360076.314352:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a10f4d000 from 7 10000000:01000000:0.0:1787360076.314355:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360076.314392:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.314401:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.314413:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360076.314433:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.314488:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.315870:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052608 00000100:00100000:1.0:1787360076.315885:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052608 00000100:00100000:1.0:1787360076.315946:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787360076.315957:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:6528:x1874182596052608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360076.315975:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360076.315994:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70400/0x359a4e2aee72025c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720255 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360076.316023:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70400/0x359a4e2aee72025c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720255 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360076.316049:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70400/0x359a4e2aee72025c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720255 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360076.316077:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70400, rc 0) 00000100:00100000:1.0:1787360076.316145:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596052608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360076.316152:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787360076.317611:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360076.317657:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360076.318648:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.318670:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360076.318874:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.318952:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.319002:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360076.319245:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052736 00000100:00100000:1.0:1787360076.319254:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052736 00000100:00100000:1.0:1787360076.319306:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787360076.319317:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596052736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.319485:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596052736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360076.319494:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787360076.320775:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.320842:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.320913:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.320954:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.321826:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052864 00000100:00100000:2.0:1787360076.321837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052864 00000100:00100000:2.0:1787360076.321903:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787360076.321915:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596052864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.322083:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596052864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.322091:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1787360076.322301:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596052864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.322971:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13807:1874182596052992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360076.323043:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.325842:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a01377d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.328195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596052992 00000100:00100000:2.0:1787360076.328216:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596052992 00000100:00100000:2.0:1787360076.328308:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787360076.328322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:13807:x1874182596052992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360076.328639:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13807:1874182596052992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787360076.328701:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360076.328714:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360076.328717:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360076.328724:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a10f4d000 00000020:00000080:0.0:1787360076.328727:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360076.328797:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360076.329125:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360076.329127:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360076.329132:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360076.329136:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360076.329137:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787360076.329141:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a10f4d000 00000020:00000080:0.0:1787360076.329143:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787360076.329348:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13807:1874182596053120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360076.329417:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360076.329456:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053120 00000100:00100000:0.0:1787360076.329463:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053120 00000100:00100000:0.0:1787360076.329493:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787360076.329501:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13807:x1874182596053120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.329699:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13807:x1874182596052992:12345-0@lo:502:llog_process_th.0 Request processed in 1378us (6666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.329709:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787360076.329926:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:13807:x1874182596053120:12345-0@lo:502:llog_process_th.0 Request processed in 424us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.329934:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787360076.329975:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0301ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360076.329993:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13807:1874182596053120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787360076.330019:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360076.330025:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360076.330026:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787360076.330041:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787360076.330401:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787360076.330425:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360076.330438:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.330449:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360076.330461:0:6528:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787360076.330464:0:6528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a0ffaa800 from 7 10000000:01000000:2.0:1787360076.330467:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360076.330499:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.330508:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.330517:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360076.330547:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.330582:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.330613:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360076.330759:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053248 00000100:00100000:3.0:1787360076.330766:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053248 00000100:00100000:3.0:1787360076.330811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1787360076.330821:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:6528:x1874182596053248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360076.330833:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360076.330849:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a350aa600/0x359a4e2aee72026a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee720263 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.330873:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a350aa600/0x359a4e2aee72026a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee720263 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.330883:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a350aa600/0x359a4e2aee72026a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee720263 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360076.330892:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aa600, rc 0) 00000100:00100000:3.0:1787360076.330925:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596053248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.330930:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000040:00080000:1.0:1787360076.331841:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360076.332028:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360076.332064:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.332078:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360076.332177:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.332252:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.332281:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360076.332339:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053376 00000100:00100000:0.0:1787360076.332345:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053376 00000100:00100000:0.0:1787360076.332391:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787360076.332400:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596053376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360076.332542:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596053376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.332550:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787360076.332763:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.332798:0:6528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360076.332844:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360076.332878:0:6528:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32300 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.334357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053504 00000100:00100000:2.0:1787360076.334372:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053504 00000100:00100000:2.0:1787360076.334428:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787360076.334438:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596053504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.334608:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:6528:x1874182596053504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.334616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787360076.334684:0:6528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a3f976a1-9d05-40f0-9d87-e3c95a944c03:6528:1874182596053504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.334909:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13809:1874182596053632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.334948:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.334970:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053632 00000100:00100000:2.0:1787360076.334973:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053632 00000100:00100000:2.0:1787360076.334989:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787360076.334994:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13809:x1874182596053632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.335069:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13809:x1874182596053632:12345-0@lo:502:llog_process_th.0 Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.335076:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787360076.335110:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.335121:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13809:1874182596053632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360076.335142:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360076.335156:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.335159:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787360076.335166:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a0ffaa800 00000020:00000080:2.0:1787360076.335168:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787360076.335254:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360076.335258:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.335260:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787360076.335262:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360076.335265:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.335266:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787360076.335269:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a0ffaa800 00000020:00000080:2.0:1787360076.335272:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787360076.335299:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13809:1874182596053760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.335328:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360076.335345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053760 00000100:00100000:2.0:1787360076.335348:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053760 00000100:00100000:2.0:1787360076.335364:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787360076.335370:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13809:x1874182596053760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360076.335419:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:13809:x1874182596053760:12345-0@lo:502:llog_process_th.0 Request processed in 49us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.335425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787360076.335447:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360076.335456:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a3f976a1-9d05-40f0-9d87-e3c95a944c03:13809:1874182596053760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360076.335469:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360076.335472:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360076.335474:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787360076.335477:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787360076.335531:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787360076.335550:0:6528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360076.335566:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360076.335578:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360076.362109:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360076.777749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360076.778457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992128 00000100:00100000:0.0:1787360076.778472:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992128 00000100:00100000:0.0:1787360076.778560:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00100000:0.0:1787360076.778573:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:6174:x1874182574992128:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360076.778617:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360076.778639:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688600/0x359a4e2aee720271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefde expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.778675:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688600/0x359a4e2aee720271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefde expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.778688:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688600/0x359a4e2aee720271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefde expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.778700:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688600, rc 0) 00000100:00100000:0.0:1787360076.778783:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992128:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 212us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.778791:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00100000:0.0:1787360076.781661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360076.781767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992256 00000100:00100000:2.0:1787360076.781776:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992256 00000100:00100000:2.0:1787360076.781820:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 362 00000100:00100000:2.0:1787360076.781830:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992256:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.781978:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992256:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 148us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.781985:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 362 00000100:00100000:1.0:1787360076.784469:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360076.785148:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992384 00000100:00100000:3.0:1787360076.785158:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992384 00000100:00100000:3.0:1787360076.785211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 363 00000100:00100000:3.0:1787360076.785222:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992384:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360076.785402:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992384:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 181us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.785573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 363 00000100:00100000:3.0:1787360076.791829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360076.796200:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992512 00000100:00100000:0.0:1787360076.796215:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992512 00000100:00100000:2.0:1787360076.796391:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 364 00000100:00100000:2.0:1787360076.796405:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:10784:x1874182574992512:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360076.796577:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+12:10784:x1874182574992512:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 174us (4756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.796586:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 364 00000100:00100000:0.0:1787360076.798994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360076.799137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992640 00000100:00100000:3.0:1787360076.799146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992640 00000100:00100000:3.0:1787360076.799195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 365 00000100:00100000:3.0:1787360076.799204:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:10784:x1874182574992640:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360076.799379:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+12:10784:x1874182574992640:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.799388:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 365 00000100:00100000:1.0:1787360076.810300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360076.810600:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992768 00000100:00100000:0.0:1787360076.810610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992768 00000100:00100000:0.0:1787360076.810666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 366 00000100:00100000:0.0:1787360076.810689:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:6174:x1874182574992768:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360076.810706:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360076.810724:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689600/0x359a4e2aee720278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefe5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.810752:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689600/0x359a4e2aee720278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefe5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.810779:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689600/0x359a4e2aee720278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefe5 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360076.810789:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689600, rc 0) 00000100:00100000:0.0:1787360076.810852:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574992768:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 165us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.810860:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 366 00000100:00100000:0.0:1787360076.815707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360076.815841:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574992896 00000100:00100000:2.0:1787360076.815851:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574992896 00000100:00100000:2.0:1787360076.815902:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 367 00000100:00100000:2.0:1787360076.815911:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574992896:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360076.816065:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574992896:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 154us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.816074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 367 00000100:00100000:2.0:1787360076.819281:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360076.820632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993024 00000100:00100000:3.0:1787360076.820642:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993024 00000100:00100000:3.0:1787360076.820700:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 368 00000100:00100000:3.0:1787360076.820710:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574993024:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360076.820849:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:6174:x1874182574993024:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 139us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360076.820858:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 368 00000100:00100000:1.0:1787360076.836278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360076.837112:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993152 00000100:00100000:0.0:1787360076.837126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993152 00000100:00100000:0.0:1787360076.837266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00100000:0.0:1787360076.837277:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:10787:x1874182574993152:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360076.837457:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:10787:x1874182574993152:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 181us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360076.837465:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00100000:0.0:1787360076.854689:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360076.854849:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993280 00000100:00100000:2.0:1787360076.854861:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993280 00000100:00100000:2.0:1787360076.854958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 370 00000100:00100000:2.0:1787360076.854969:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:10787:x1874182574993280:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360076.855127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:10787:x1874182574993280:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 159us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360076.855135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 370 00010000:00010000:3.0:1787360076.921405:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360077.369943:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787360077.370671:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787360077.945853:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360078.073641:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360078.073741:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360078.073980:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596053888 00000100:00100000:2.0:1787360078.073991:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596053888 00000100:00100000:2.0:1787360078.074060:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787360078.074072:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596053888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360078.074129:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360078.074199:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596053888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360078.074208:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787360078.074394:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360078.708008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360078.708248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360078.708297:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360078.708363:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993792 00000100:00100000:0.0:1787360078.708378:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993792 00000100:00100000:0.0:1787360078.708476:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:0.0:1787360078.708490:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993792:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360078.708633:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993792:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 147us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360078.708642:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00080000:1.0:1787360078.709149:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360078.710863:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993536 00000100:00100000:3.0:1787360078.710883:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993536 00000100:00100000:2.0:1787360078.710990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360078.711042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360078.711069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360078.711096:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994048 00000100:00100000:2.0:1787360078.711101:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994048 00000100:00100000:3.0:1787360078.711195:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993664 00000100:00100000:3.0:1787360078.711199:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993664 00000100:00080000:1.0:1787360078.711255:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360078.711272:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360078.711319:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993920 00000100:00100000:1.0:1787360078.711339:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993920 00000100:00100000:1.0:1787360078.711370:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:1.0:1787360078.711382:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993536:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360078.711496:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993536:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 114us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360078.711505:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:1.0:1787360078.711537:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00100000:1.0:1787360078.711545:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574993920:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360078.711571:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574993920:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360078.711577:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00080000:1.0:1787360078.711598:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360078.711832:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574993408 00000100:00100000:0.0:1787360078.711837:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574993408 00000100:00100000:0.0:1787360078.711880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 371 00000100:00100000:0.0:1787360078.711889:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574993408:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360078.711924:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182574993408:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360078.711931:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 371 00000100:00100000:2.0:1787360078.717552:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 231 00000100:00100000:2.0:1787360078.717579:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574994048:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360078.717712:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574994048:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 145us (9413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360078.717738:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 231 00000100:00100000:3.0:1787360078.719045:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 232 00000100:00100000:3.0:1787360078.719060:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993664:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360078.719148:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574993664:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 92us (8105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360078.719155:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 232 00010000:00010000:1.0:1787360078.969926:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360079.099091:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596054016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360079.099201:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360079.099440:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596054144:0@lo:400:kworker.0 00000100:00100000:2.0:1787360079.099495:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360079.099562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054144 00000100:00100000:2.0:1787360079.099571:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054144 00000100:00100000:2.0:1787360079.099633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787360079.099644:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596054144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360079.099717:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596054144:12345-0@lo:400:kworker.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360079.099725:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1787360079.099779:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596054144:0@lo:400:kworker.0 00000100:00100000:3.0:1787360079.100778:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054016 00000100:00100000:3.0:1787360079.100791:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054016 00000100:00100000:3.0:1787360079.100857:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360079.100871:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596054016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360079.100906:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360079.101220:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596054272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360079.101279:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360079.101339:0:8451:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787360079.101348:0:8451:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787360079.101497:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054272 00000100:00100000:2.0:1787360079.101509:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054272 00000100:00100000:2.0:1787360079.101630:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787360079.101639:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596054272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360079.101654:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360079.101703:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596054272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360079.101710:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1787360079.101751:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb7b80 x1874182596054272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360079.101784:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596054272:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787360079.101835:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360079.105442:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596054656:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105558:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.105606:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596055168:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105638:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.105675:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787360079.105681:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596054528:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105710:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.105732:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596055040:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105752:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.105769:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596055552:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105790:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.105826:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055168 00000100:00100000:1.0:1787360079.105852:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055168 00000100:00100000:1.0:1787360079.105925:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360079.105937:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596055168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.105996:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596055168:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106005:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360079.106048:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054656 00000100:00100000:1.0:1787360079.106052:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054656 00000100:00100000:1.0:1787360079.106080:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055040 00000100:00100000:1.0:1787360079.106083:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055040 00000100:00100000:1.0:1787360079.106105:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055552 00000100:00100000:1.0:1787360079.106108:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055552 00000100:00100000:1.0:1787360079.106125:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787360079.106132:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596054656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106167:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596054656:12345-0@lo:400:kworker.0 Request processed in 36us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106174:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787360079.106186:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787360079.106192:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596055040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106218:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596055040:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106257:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787360079.106270:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787360079.106276:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106303:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596055552:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106309:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:1.0:1787360079.106364:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904082300 x1874182596055040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360079.106379:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596055040:0@lo:400:kworker.0 00010000:00080000:1.0:1787360079.106389:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3df80 x1874182596055552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360079.106398:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596055552:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106408:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596054656:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106417:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596055168:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106458:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596054784:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106486:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.106506:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596055296:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106529:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.106551:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787360079.106558:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596054400:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106581:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.106596:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596054912:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106615:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.106630:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596055424:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106651:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360079.106675:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054528 00000100:00100000:1.0:1787360079.106679:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054528 00000100:00100000:1.0:1787360079.106707:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054784 00000100:00100000:1.0:1787360079.106710:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054784 00000100:00100000:1.0:1787360079.106722:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787360079.106736:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596054528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106780:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596054528:12345-0@lo:400:kworker.0 Request processed in 44us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106786:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787360079.106798:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787360079.106804:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596054784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106836:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596054784:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106842:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787360079.106857:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054400 00000100:00100000:1.0:1787360079.106860:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054400 00000100:00100000:1.0:1787360079.106878:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596054912 00000100:00100000:1.0:1787360079.106882:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596054912 00000100:00100000:1.0:1787360079.106894:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055424 00000100:00100000:1.0:1787360079.106896:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055424 00000100:00100000:1.0:1787360079.106909:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787360079.106914:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596054400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106942:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596054400:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106948:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787360079.106960:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787360079.106966:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596054912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.106992:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596054912:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.106998:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787360079.107009:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787360079.107029:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107066:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596055424:12345-0@lo:400:kworker.0 Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.107073:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787360079.107104:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596054528:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107131:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596054400:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107140:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596054912:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107148:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596055424:0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107157:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596054784:0@lo:400:kworker.0 00000100:00080000:1.0:1787360079.107177:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787360079.107182:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360079.107186:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360079.107217:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055296 00000100:00100000:1.0:1787360079.107222:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055296 00000100:00100000:1.0:1787360079.107281:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360079.107289:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596055296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360079.107324:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596055296:12345-0@lo:400:kworker.0 Request processed in 37us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360079.107331:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360079.107357:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596055296:0@lo:400:kworker.0 00000100:00080000:1.0:1787360079.107370:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360079.110747:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596054016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9866us (11532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360079.110766:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1787360079.110937:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb4380 x1874182596054016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360079.110967:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596054016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787360079.997000:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360080.124264:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360080.130730:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596055680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360080.131314:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360080.131444:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055680 00000100:00100000:1.0:1787360080.131456:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055680 00000100:00100000:1.0:1787360080.131529:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787360080.131555:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596055680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360080.131617:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787360080.131704:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596055680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360080.131712:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787360080.131784:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596055680:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1787360080.641804:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1787360081.021110:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360081.145569:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360081.145599:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596055808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360081.145692:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360081.145944:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055808 00000100:00100000:2.0:1787360081.145953:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055808 00000100:00100000:3.0:1787360081.145985:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360081.145998:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596055936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360081.146029:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787360081.146042:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596055808:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360081.146046:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360081.146075:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596055936 00002000:00000024:2.0:1787360081.146077:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360081.146079:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596055936 00000100:00100000:3.0:1787360081.146102:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787360081.146108:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596055936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360081.146119:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360081.146125:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596055808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360081.146132:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787360081.146147:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596055936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360081.146153:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787360081.146199:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596055936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360081.146286:0:3659:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787360081.146293:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998903b3d500, transno 4294967301 00000100:00100000:0.0:1787360081.146316:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596055808:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787360081.146499:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787360082.041897:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360083.065486:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360083.193804:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360083.193839:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596056064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360083.193937:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360083.194393:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056064 00000100:00100000:2.0:1787360083.194405:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056064 00000100:00100000:2.0:1787360083.194472:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787360083.194483:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596056064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360083.194526:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360083.194609:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596056064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360083.194617:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787360083.195344:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596056064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360083.819567:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360083.819702:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360083.821777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360083.822324:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994176 00000100:00100000:1.0:1787360083.822339:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994176 00000100:00100000:1.0:1787360083.822428:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 373 00000100:00100000:1.0:1787360083.822442:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574994176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360083.822552:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574994176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 112us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360083.822561:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 373 00000100:00100000:2.0:1787360083.822614:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994304 00000100:00100000:2.0:1787360083.822621:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994304 00000100:00100000:2.0:1787360083.822685:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994432 00000100:00100000:2.0:1787360083.822704:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994432 00000100:00100000:2.0:1787360083.822735:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:2.0:1787360083.822744:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360083.822786:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 44us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360083.822793:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:2.0:1787360083.822808:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00100000:2.0:1787360083.822829:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360083.822856:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360083.822862:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00080000:1.0:1787360083.822963:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360083.822968:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360083.828923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360083.829065:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994560 00000100:00100000:1.0:1787360083.829080:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994560 00000100:00100000:1.0:1787360083.829287:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360083.829302:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994560:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360083.829401:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574994560:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 102us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360083.829410:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00080000:2.0:1787360083.835265:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360083.837340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360083.837506:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994688 00000100:00100000:1.0:1787360083.837529:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994688 00000100:00100000:1.0:1787360083.837624:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:1.0:1787360083.837636:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574994688:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:2.0:1787360083.837813:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360083.840258:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574994688:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2592us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360083.840280:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:0.0:1787360083.845356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360083.850176:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994816 00000100:00100000:2.0:1787360083.850198:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994816 00000100:00100000:2.0:1787360083.853518:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:2.0:1787360083.853538:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574994816:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360083.853656:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574994816:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 125us (8317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360083.853665:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00080000:1.0:1787360083.856894:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787360084.089441:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360084.217566:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360084.217679:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360084.218124:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360084.218136:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596056320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360084.218170:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.218183:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056192 00000100:00100000:2.0:1787360084.218193:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056192 00000100:00100000:2.0:1787360084.218286:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056320 00000100:00100000:2.0:1787360084.218290:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056320 00000100:00100000:2.0:1787360084.218316:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787360084.218337:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787360084.218350:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596056320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360084.218391:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360084.218464:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596056320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.218474:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787360084.218479:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596056576:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.218521:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.218542:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596056192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360084.218574:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360084.218612:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596056192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 286us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.218619:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787360084.218622:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596056448:0@lo:400:kworker.0 00000100:00100000:2.0:1787360084.218657:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056576 00000100:00100000:2.0:1787360084.218662:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056576 00000100:00100000:2.0:1787360084.218695:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787360084.218703:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596056576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.219193:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360084.219284:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360084.219306:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596056704:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.219407:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596056576:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.219415:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596057088:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.221941:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596056960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.222106:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360084.222793:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596057472:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.222839:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787360084.222895:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902917800 x1874182596056320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360084.223292:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596056320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360084.223332:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787360084.223342:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596056832:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.223382:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360084.223600:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596057344:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.223634:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360084.223688:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056832 00000100:00100000:3.0:1787360084.223713:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056832 00000100:00100000:3.0:1787360084.223864:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787360084.223876:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596056832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.223955:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596056832:12345-0@lo:400:kworker.0 Request processed in 67us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.223963:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787360084.224007:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056448 00000100:00100000:3.0:1787360084.224012:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056448 00000100:00100000:3.0:1787360084.224052:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787360084.224060:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596056448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.224097:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596056448:12345-0@lo:400:kworker.0 Request processed in 38us (5432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.224103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1787360084.224137:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056960 00000100:00100000:3.0:1787360084.224142:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056960 00000100:00100000:3.0:1787360084.224179:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787360084.224186:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596056960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.224223:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596056960:12345-0@lo:400:kworker.0 Request processed in 38us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.224252:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787360084.224272:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057472 00000100:00100000:3.0:1787360084.224276:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057472 00000100:00100000:3.0:1787360084.224322:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057344 00000100:00100000:3.0:1787360084.224328:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057344 00000100:00100000:3.0:1787360084.224822:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787360084.224843:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596057472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.224895:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596057472:12345-0@lo:400:kworker.0 Request processed in 58us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.224915:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787360084.224931:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787360084.224937:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596057344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.225034:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596057344:12345-0@lo:400:kworker.0 Request processed in 97us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.225041:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787360084.225114:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596056832:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.225127:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596057344:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.225139:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596056448:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.225149:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596056960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.225159:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596057472:0@lo:400:kworker.0 00000100:00080000:3.0:1787360084.225294:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360084.228691:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360084.228913:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596056704 00000100:00100000:3.0:1787360084.228925:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596056704 00000100:00100000:3.0:1787360084.228997:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787360084.229010:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596056704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360084.229166:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596056576:12345-0@lo:400:kworker.0 Request processed in 10460us (10642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.229178:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787360084.232399:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360084.233705:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596057600:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.233793:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360084.233886:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596057216:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.234241:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596056704:12345-0@lo:400:kworker.0 Request processed in 5215us (5544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360084.234255:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787360084.236586:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.237149:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057088 00000100:00100000:2.0:1787360084.237162:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057088 00000100:00100000:2.0:1787360084.237281:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057600 00000100:00100000:2.0:1787360084.237285:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057600 00000100:00100000:2.0:1787360084.237317:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787360084.237327:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596057088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360084.237429:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596057088:12345-0@lo:400:kworker.0 Request processed in 103us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.237436:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787360084.237454:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787360084.237460:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596057600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360084.237484:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596057600:12345-0@lo:400:kworker.0 Request processed in 25us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.237489:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787360084.237938:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596057728:0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.237981:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360084.238017:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057216 00000100:00100000:0.0:1787360084.238021:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057216 00000100:00100000:0.0:1787360084.238050:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057728 00000100:00100000:0.0:1787360084.238052:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057728 00000100:00100000:0.0:1787360084.238068:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787360084.238073:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596057216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.238105:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596057216:12345-0@lo:400:kworker.0 Request processed in 32us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360084.238111:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787360084.238123:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787360084.238128:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596057728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.238147:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1874182596057728:12345-0@lo:400:kworker.0 Request processed in 20us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360084.238172:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00010000:00080000:0.0:1787360084.238213:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904081880 x1874182596057728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360084.238264:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3661:1874182596057728:0@lo:400:kworker.0 00010000:00080000:0.0:1787360084.238288:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3feb4e00 x1874182596056192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360084.238307:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360084.238344:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596056704:0@lo:400:kworker.0 00010000:00080000:0.0:1787360084.238359:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998903b3ea00 x1874182596057216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360084.238368:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596057216:0@lo:400:kworker.0 00000100:00080000:1.0:1787360084.238522:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360084.238528:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360084.238567:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596057088:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.238588:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596057600:0@lo:400:kworker.0 00010000:00010000:1.0:1787360085.114036:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360085.241713:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596057856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360085.241817:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360085.242624:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057856 00000100:00100000:2.0:1787360085.242655:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057856 00000100:00100000:2.0:1787360085.244020:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787360085.244049:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596057856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360085.244103:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787360085.244372:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596057856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 335us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360085.244381:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787360085.244457:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596057856:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360086.137377:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360086.265689:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360086.265726:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360086.265822:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360086.266057:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596057984 00000100:00100000:0.0:1787360086.266067:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596057984 00000100:00100000:0.0:1787360086.266191:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787360086.266205:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596057984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360086.266274:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360086.266334:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596057984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360086.266341:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787360086.266401:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360086.266600:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596058112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360086.266641:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360086.266770:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904083100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360086.278565:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058112 00000100:00100000:2.0:1787360086.278592:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058112 00000100:00100000:2.0:1787360086.278706:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787360086.278718:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596058112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360086.278754:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360086.278866:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596058112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (12224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360086.278874:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787360086.280484:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360086.280579:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904082300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596058112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787360087.161367:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360087.611303:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787360087.611779:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360088.186858:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360088.313884:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360088.313907:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596058240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360088.313987:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360088.314121:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058240 00000100:00100000:0.0:1787360088.314130:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058240 00000100:00100000:0.0:1787360088.314179:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787360088.314188:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596058240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360088.314260:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360088.314320:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596058240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360088.314327:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787360088.314728:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596058240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360088.937562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360088.937611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360088.937646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574994944 00000100:00100000:0.0:1787360088.937653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360088.937659:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574994944 00000100:00100000:0.0:1787360088.937698:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360088.937713:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 375 00000100:00100000:3.0:1787360088.937727:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574994944:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360088.937728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360088.937767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360088.937800:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182574994944:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360088.937808:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 375 00000100:00100000:1.0:1787360088.937837:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995200 00000100:00100000:1.0:1787360088.937843:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995200 00000100:00100000:3.0:1787360088.937846:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995328 00000100:00100000:3.0:1787360088.937851:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995328 00000100:00100000:3.0:1787360088.937889:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:3.0:1787360088.937896:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574995328:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360088.937901:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995456 00000100:00100000:1.0:1787360088.937907:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995456 00000100:00100000:2.0:1787360088.937974:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995072 00000100:00100000:2.0:1787360088.937979:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995072 00000100:00100000:1.0:1787360088.938026:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995584 00000100:00100000:1.0:1787360088.938030:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995584 00000100:00100000:2.0:1787360088.938363:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:2.0:1787360088.938372:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574995200:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360088.940342:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574995328:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2434us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360088.940358:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00080000:0.0:1787360088.940554:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360088.940560:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360088.940564:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360088.940596:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:0.0:1787360088.940610:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574995456:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360088.940987:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574995456:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 379us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360088.940995:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:3.0:1787360088.941025:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:3.0:1787360088.941036:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574995072:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360088.941269:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182574995200:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2896us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360088.941279:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:1.0:1787360088.941629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:1.0:1787360088.941640:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574995584:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360088.941699:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182574995584:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 61us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360088.941705:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:3.0:1787360088.943220:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182574995072:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 2174us (5510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360088.943252:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 251 00010000:00010000:3.0:1787360089.209374:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360089.337998:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596058496:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338071:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338135:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596059008:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338160:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338182:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596059520:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338205:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338254:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787360089.338276:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596058368:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338309:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338333:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596058880:0@lo:400:kworker.0 00000100:00100000:0.0:1787360089.338365:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596058624:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338376:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338400:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596059392:0@lo:400:kworker.0 00000100:00100000:0.0:1787360089.338407:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360089.338436:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596059136:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338437:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338460:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596059904:0@lo:400:kworker.0 00000100:00100000:0.0:1787360089.338471:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.338492:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360089.338496:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596059648:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.338517:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360089.338526:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360089.338619:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058880 00000100:00100000:2.0:1787360089.338625:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058880 00000100:00100000:2.0:1787360089.338675:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058624 00000100:00100000:2.0:1787360089.338679:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058624 00000100:00100000:2.0:1787360089.338693:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787360089.338701:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596058880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339080:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360089.339129:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058496 00000100:00100000:1.0:1787360089.339134:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058496 00000100:00100000:1.0:1787360089.339157:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059008 00000100:00100000:1.0:1787360089.339160:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059008 00000100:00100000:1.0:1787360089.339183:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059520 00000100:00100000:1.0:1787360089.339186:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059520 00000100:00100000:1.0:1787360089.339199:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059136 00000100:00100000:1.0:1787360089.339202:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059136 00000100:00100000:1.0:1787360089.339215:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059648 00000100:00100000:1.0:1787360089.339217:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059648 00000100:00100000:1.0:1787360089.339261:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787360089.339269:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596058496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339315:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596058496:12345-0@lo:400:kworker.0 Request processed in 47us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339321:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787360089.339340:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787360089.339346:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596059008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339399:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596059008:12345-0@lo:400:kworker.0 Request processed in 53us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339406:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787360089.339422:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787360089.339428:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596059520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339455:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596059520:12345-0@lo:400:kworker.0 Request processed in 27us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339460:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787360089.339473:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787360089.339478:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596059136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339505:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596059136:12345-0@lo:400:kworker.0 Request processed in 28us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339510:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787360089.339523:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787360089.339528:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596059648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339740:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596059648:12345-0@lo:400:kworker.0 Request processed in 211us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339746:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787360089.339788:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596058496:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339800:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596059008:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339810:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596059520:0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339854:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787360089.339862:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596058624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360089.339905:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596058624:12345-0@lo:400:kworker.0 Request processed in 44us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360089.339911:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787360089.339940:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360089.339944:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360089.340100:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058368 00000100:00100000:3.0:1787360089.340106:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058368 00000100:00100000:3.0:1787360089.340145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787360089.340153:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596058368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340199:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3659:x1874182596058368:12345-0@lo:400:kworker.0 Request processed in 47us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340206:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1787360089.340257:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059392 00000100:00100000:3.0:1787360089.340261:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059392 00000100:00100000:3.0:1787360089.340289:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059904 00000100:00100000:3.0:1787360089.340292:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059904 00000100:00100000:3.0:1787360089.340311:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360089.340317:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596059392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340347:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596059392:12345-0@lo:400:kworker.0 Request processed in 31us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340353:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360089.340379:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787360089.340385:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596059904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340416:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596059904:12345-0@lo:400:kworker.0 Request processed in 32us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340423:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1787360089.340451:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904041f80 x1874182596059648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360089.340452:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060032 00000100:00100000:3.0:1787360089.340456:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060032 00000100:00100000:0.0:1787360089.340475:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596059648:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340486:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787360089.340495:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360089.340503:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596060160:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360089.340516:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360089.340546:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360089.340575:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340582:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787360089.340585:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596058624:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340595:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060160 00010000:00080000:0.0:1787360089.340602:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35055f80 x1874182596059136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360089.340606:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060160 00000100:00100000:0.0:1787360089.340616:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596059136:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340637:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787360089.340637:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787360089.340648:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596060160:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360089.340649:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596058752:0@lo:400:kworker.0 00002000:00000024:3.0:1787360089.340666:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360089.340687:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360089.340711:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596060160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340719:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787360089.340719:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596059264:0@lo:400:kworker.0 00000100:00080000:3.0:1787360089.340751:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360089.340752:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787360089.340757:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787360089.340784:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902917480 x1874182596060032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360089.340799:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360089.340808:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596058368:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340819:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596059392:0@lo:400:kworker.0 00010000:00080000:3.0:1787360089.340827:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a3b80 x1874182596059904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360089.340833:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596059904:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340855:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059264 00000100:00100000:0.0:1787360089.340856:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596059776:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340860:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059264 00000100:00100000:0.0:1787360089.340895:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360089.340899:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787360089.340908:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596059264:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787360089.340929:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1c00 x1874182596060160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360089.340944:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596060160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360089.340950:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596059264:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.340958:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360089.340980:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596059264:0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.340981:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596059776 00000100:00100000:3.0:1787360089.340993:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596059776 00000100:00100000:0.0:1787360089.341018:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596058752 00000100:00100000:0.0:1787360089.341023:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596058752 00000100:00100000:3.0:1787360089.341027:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787360089.341034:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596059776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360089.341066:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787360089.341081:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596059776:12345-0@lo:400:kworker.0 Request processed in 42us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360089.341081:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596058752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360089.341091:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787360089.341112:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360089.341133:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596058752:12345-0@lo:400:kworker.0 Request processed in 58us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360089.341141:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787360089.341175:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596058752:0@lo:400:kworker.0 00010000:00080000:0.0:1787360089.341185:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c84fb80 x1874182596059776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360089.341193:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596059776:0@lo:400:kworker.0 00000100:00100000:2.0:1787360089.343204:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596058880:12345-0@lo:400:kworker.0 Request processed in 4494us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360089.343218:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787360089.344140:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596058880:0@lo:400:kworker.0 00010000:00010000:3.0:1787360090.234046:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360090.362362:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596060288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360090.362447:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360090.362641:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060288 00000100:00100000:0.0:1787360090.362649:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060288 00000100:00100000:0.0:1787360090.362704:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787360090.362713:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596060288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360090.362744:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787360090.362803:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596060288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360090.362811:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787360090.362896:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596060288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787360091.259187:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360091.385711:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360091.385826:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360091.385845:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596060544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360091.385910:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360091.385997:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060544 00000100:00100000:3.0:1787360091.386005:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060544 00000100:00100000:3.0:1787360091.386064:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787360091.386073:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596060544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360091.386098:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360091.386138:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596060544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360091.386145:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787360091.386167:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360091.386198:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596060544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360091.396357:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3b9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360091.396426:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360091.400790:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060416 00000100:00100000:1.0:1787360091.400805:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060416 00000100:00100000:1.0:1787360091.401019:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787360091.401150:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360091.401174:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360091.401297:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360091.401520:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3b9b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787360091.404387:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360091.410686:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:3.0:1787360092.281375:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360093.305372:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360093.434624:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596060672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360093.434708:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360093.435470:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060672 00000100:00100000:2.0:1787360093.435479:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060672 00000100:00100000:2.0:1787360093.435533:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787360093.435543:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596060672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360093.435577:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360093.435646:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596060672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360093.435653:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787360093.435778:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596060672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360094.063024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360094.063578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995712 00000100:00100000:3.0:1787360094.063588:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995712 00000100:00100000:3.0:1787360094.063645:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 377 00000100:00100000:3.0:1787360094.063655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182574995712:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360094.063728:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182574995712:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 73us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.063735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 377 00000100:00100000:1.0:1787360094.091635:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360094.091678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360094.091703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360094.091737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360094.091820:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995840 00000100:00100000:0.0:1787360094.091829:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995840 00000100:00100000:0.0:1787360094.091888:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574995968 00000100:00100000:0.0:1787360094.091891:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574995968 00000100:00100000:0.0:1787360094.091909:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996352 00000100:00100000:0.0:1787360094.091912:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996352 00000100:00100000:0.0:1787360094.091958:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 259 00000100:00100000:0.0:1787360094.091969:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574995840:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360094.092038:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574995840:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 71us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.092046:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 259 00000100:00100000:0.0:1787360094.092062:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 260 00000100:00100000:0.0:1787360094.092068:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574995968:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360094.092092:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574995968:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.092098:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 260 00000100:00100000:0.0:1787360094.092108:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:0.0:1787360094.092115:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574996352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360094.092135:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182574996352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.092141:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:3.0:1787360094.092523:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996096 00000100:00100000:3.0:1787360094.092528:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996096 00000100:00100000:3.0:1787360094.092562:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1787360094.092569:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182574996096:12345-192.168.206.11@tcp:9:kworker.0 00000020:00000080:3.0:1787360094.092598:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72019f 00000100:00080000:3.0:1787360094.092605:0:8450:0:(import.c:65:import_set_state_nolock()) ffff998a31315800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360094.092646:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787360094.092758:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+2:2398:x1874182574996096:12345-192.168.206.11@tcp:9:kworker.0 Request processed in 189us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.092765:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00010000:00010000:3.0:1787360094.092791:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360094.092912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00080000:1.0:1787360094.093129:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360094.093135:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360094.093137:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360094.093283:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996224 00000100:00100000:2.0:1787360094.093288:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996224 00000100:00100000:2.0:1787360094.093347:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 262 00000100:00100000:2.0:1787360094.093354:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574996224:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360094.093392:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574996224:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.093398:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 262 00000100:00080000:1.0:1787360094.093454:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360094.330375:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360094.458099:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596060928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360094.458115:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360094.458131:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360094.458175:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360094.458207:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060800 00000100:00100000:3.0:1787360094.458215:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060800 00000100:00080000:0.0:1787360094.458280:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360094.458290:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787360094.458304:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360094.458332:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360094.458365:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.458398:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596061312:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.458442:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.458465:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360094.458470:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596061184:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.458523:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.458548:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596061440:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.458570:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.458588:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360094.458594:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596061056:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.458620:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.458648:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061056 00000100:00100000:2.0:1787360094.458653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061056 00000100:00100000:2.0:1787360094.458680:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787360094.458687:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596061056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.458718:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596060800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 416us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.458734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596061056:12345-0@lo:400:kworker.0 Request processed in 45us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.458735:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787360094.458745:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787360094.458757:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596060928 00000100:00100000:3.0:1787360094.458763:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596060928 00000100:00100000:2.0:1787360094.458793:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596061056:0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.458798:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787360094.458809:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596060928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360094.458820:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360094.458837:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061312 00000100:00100000:2.0:1787360094.458842:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061312 00000100:00100000:3.0:1787360094.458862:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596060928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.458869:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787360094.458875:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787360094.458884:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596061312:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787360094.458888:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360094.458913:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061184 00000100:00100000:3.0:1787360094.458917:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061184 00000100:00100000:2.0:1787360094.458933:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596061312:12345-0@lo:400:kworker.0 Request processed in 40us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.458947:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787360094.458958:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061440 00000100:00100000:3.0:1787360094.458963:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061440 00000100:00100000:2.0:1787360094.458985:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596061312:0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.458991:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787360094.459000:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596061184:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787360094.459002:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3c9a1180 x1874182596060928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360094.459020:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596060928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360094.459042:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596061184:12345-0@lo:400:kworker.0 Request processed in 42us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.459049:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787360094.459056:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596061184:0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.459067:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787360094.459076:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596061440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.459115:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596061440:12345-0@lo:400:kworker.0 Request processed in 42us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.459121:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787360094.459149:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596061440:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459511:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596061696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459541:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.459570:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596062208:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459592:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.459612:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787360094.459617:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596061824:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459697:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.459715:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596062336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459737:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360094.459762:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061696 00000100:00100000:2.0:1787360094.459767:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061696 00000100:00100000:2.0:1787360094.459792:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062208 00000100:00100000:2.0:1787360094.459796:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062208 00000100:00100000:2.0:1787360094.459808:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061824 00000100:00100000:2.0:1787360094.459810:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061824 00000100:00100000:2.0:1787360094.459821:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062336 00000100:00100000:2.0:1787360094.459824:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062336 00000100:00100000:2.0:1787360094.459838:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787360094.459844:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596061696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.459883:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596061696:12345-0@lo:400:kworker.0 Request processed in 39us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.459890:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787360094.459903:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787360094.459909:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596062208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360094.460079:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787360094.460089:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596061824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360094.460125:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596061824:12345-0@lo:400:kworker.0 Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.460131:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787360094.460145:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787360094.460152:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596062336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360094.460178:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596062336:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.460184:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787360094.460307:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596062208:12345-0@lo:400:kworker.0 Request processed in 398us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.460437:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:2.0:1787360094.460469:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0700 x1874182596061824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360094.460481:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596061824:0@lo:400:kworker.0 00010000:00080000:2.0:1787360094.460491:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eea0000 x1874182596062336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360094.460499:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596062336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.460509:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596061696:0@lo:400:kworker.0 00000100:00100000:2.0:1787360094.460518:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596062208:0@lo:400:kworker.0 00000100:00080000:3.0:1787360094.461964:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360094.461985:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360094.462013:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596061952:0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.462068:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360094.462085:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596061568:0@lo:400:kworker.0 00000100:00100000:0.0:1787360094.462124:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360094.462160:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596062080:0@lo:400:kworker.0 00000100:00100000:0.0:1787360094.462183:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787360094.462253:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890388c700 x1874182596060800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360094.462272:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596060800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360094.462871:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061952 00000100:00100000:3.0:1787360094.462879:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061952 00000100:00100000:3.0:1787360094.462927:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062080 00000100:00100000:3.0:1787360094.462930:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062080 00000100:00100000:3.0:1787360094.462966:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787360094.462975:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596061952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.463032:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596061952:12345-0@lo:400:kworker.0 Request processed in 58us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.463040:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787360094.463055:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596061568 00000100:00100000:1.0:1787360094.463061:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596061568 00000100:00100000:3.0:1787360094.463062:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787360094.463073:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596062080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360094.463102:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787360094.463108:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596062080:12345-0@lo:400:kworker.0 Request processed in 36us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.463113:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596061568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360094.463119:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787360094.463145:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360094.463163:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596061568:12345-0@lo:400:kworker.0 Request processed in 53us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.463170:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787360094.463178:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596061952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360094.464105:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596061568:0@lo:400:kworker.0 00000100:00100000:0.0:1787360094.464119:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596062080:0@lo:400:kworker.0 00010000:00010000:3.0:1787360095.353390:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360095.481480:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360095.481503:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596062464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360095.481574:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360095.482277:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062464 00000100:00100000:2.0:1787360095.482287:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062464 00000100:00100000:2.0:1787360095.482344:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787360095.482354:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596062464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360095.482385:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787360095.482452:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596062464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360095.482460:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787360095.482540:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890388c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596062464:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360096.380787:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360096.506791:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596062592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360096.506861:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360096.508036:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062592 00000100:00100000:1.0:1787360096.508048:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062592 00000100:00100000:1.0:1787360096.508115:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787360096.508125:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596062592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360096.508481:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787360096.508514:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360096.508633:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596062592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 501us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.508648:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787360096.508728:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596062592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360096.508852:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360096.508863:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596062720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360096.508977:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360096.509041:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062720 00000100:00100000:2.0:1787360096.509047:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062720 00000100:00100000:2.0:1787360096.509125:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787360096.509188:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360096.509315:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596062720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360096.509341:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360096.509420:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596062720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 287us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360096.509426:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787360096.509475:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596062720:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787360097.402816:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360097.851833:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787360097.858390:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787360098.442314:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360098.553389:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360098.553411:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596062848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360098.553472:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360098.553707:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062848 00000100:00100000:1.0:1787360098.553713:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062848 00000100:00100000:1.0:1787360098.553764:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787360098.553774:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596062848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360098.553808:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787360098.553853:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596062848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360098.553860:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787360098.553961:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596062848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360099.179709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360099.179754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360099.179805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360099.179838:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996608 00000100:00100000:0.0:1787360099.179847:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996608 00000100:00100000:0.0:1787360099.179898:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996864 00000100:00100000:0.0:1787360099.179901:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996864 00000100:00100000:0.0:1787360099.179934:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 269 00000100:00100000:0.0:1787360099.179943:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574996608:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360099.180004:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182574996608:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360099.180012:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 269 00000100:00100000:0.0:1787360099.180040:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 270 00000100:00100000:0.0:1787360099.180046:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574996864:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360099.180084:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182574996864:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360099.180090:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 270 00000100:00080000:0.0:1787360099.180106:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360099.180947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996480 00000100:00100000:3.0:1787360099.180955:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996480 00000100:00100000:3.0:1787360099.181001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 379 00000100:00100000:3.0:1787360099.181010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574996480:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360099.181476:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574996480:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 54us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360099.181484:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 379 00000100:00100000:2.0:1787360099.188454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360099.190255:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360099.190297:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996736 00000100:00100000:2.0:1787360099.190306:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996736 00000100:00100000:2.0:1787360099.190360:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574996992 00000100:00100000:2.0:1787360099.190363:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574996992 00000100:00100000:2.0:1787360099.190384:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:2.0:1787360099.190394:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574996736:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360099.190476:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574996736:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 84us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.190483:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 271 00000100:00100000:2.0:1787360099.190500:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 272 00000100:00100000:2.0:1787360099.190506:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574996992:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360099.190528:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574996992:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.190534:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 272 00000100:00080000:2.0:1787360099.190553:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787360099.449359:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360099.577433:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360099.577456:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596062976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360099.577522:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.577980:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596063104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360099.578025:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360099.578109:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596062976 00000100:00100000:3.0:1787360099.578117:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596062976 00000100:00100000:3.0:1787360099.578171:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063104 00000100:00100000:3.0:1787360099.578174:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063104 00000100:00100000:3.0:1787360099.578192:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787360099.578201:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596062976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360099.578258:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360099.578303:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596062976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360099.578310:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787360099.578327:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787360099.578334:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596063104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360099.578344:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360099.578370:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596063104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360099.578375:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1787360099.578431:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787360099.578463:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902917480 x1874182596063104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360099.578481:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596063104:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787360099.578494:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890394aa00 x1874182596062976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360099.578505:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596062976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360099.578986:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596063360:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579023:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579053:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596063872:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579075:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579093:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596064384:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579113:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579132:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787360099.579138:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596063232:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579165:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579188:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596063744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579211:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579252:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596064256:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579278:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.579307:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063360 00000100:00100000:2.0:1787360099.579311:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063360 00000100:00100000:2.0:1787360099.579345:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063872 00000100:00100000:2.0:1787360099.579359:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063872 00000100:00100000:2.0:1787360099.579384:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064384 00000100:00100000:2.0:1787360099.579387:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064384 00000100:00100000:2.0:1787360099.579401:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787360099.579408:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596063360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579451:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596063360:12345-0@lo:400:kworker.0 Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579458:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787360099.579472:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787360099.579479:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596063872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579506:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596063872:12345-0@lo:400:kworker.0 Request processed in 28us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579512:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787360099.579524:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787360099.579529:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596064384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579554:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596064384:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579559:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787360099.579581:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063232 00000100:00100000:2.0:1787360099.579584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063232 00000100:00100000:2.0:1787360099.579607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787360099.579613:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596063232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579642:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596063232:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787360099.579672:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063744 00000100:00100000:2.0:1787360099.579676:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063744 00000100:00100000:2.0:1787360099.579726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787360099.579733:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596063744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579767:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596063744:12345-0@lo:400:kworker.0 Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579772:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787360099.579792:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064256 00000100:00100000:2.0:1787360099.579796:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064256 00000100:00100000:2.0:1787360099.579821:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787360099.579828:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596064256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579857:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596064256:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.579862:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1787360099.579889:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360099.579893:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360099.579923:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596063232:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579935:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596063744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579943:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596064256:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579953:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596063360:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579962:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596063872:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.579971:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596064384:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580002:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596063616:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580027:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.580044:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596064128:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580074:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.580095:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787360099.580100:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596063488:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580121:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.580138:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596064000:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580155:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.580170:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596064512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360099.580213:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064128 00000100:00100000:2.0:1787360099.580217:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064128 00000100:00100000:2.0:1787360099.580270:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787360099.580277:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596064128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580312:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596064128:12345-0@lo:400:kworker.0 Request processed in 35us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.580318:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787360099.580335:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063488 00000100:00100000:2.0:1787360099.580339:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063488 00000100:00100000:2.0:1787360099.580360:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787360099.580366:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596063488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580395:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596063488:12345-0@lo:400:kworker.0 Request processed in 30us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.580401:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787360099.580419:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596063616 00000100:00100000:2.0:1787360099.580423:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596063616 00000100:00100000:2.0:1787360099.580440:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064000 00000100:00100000:2.0:1787360099.580443:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064000 00000100:00100000:2.0:1787360099.580455:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064512 00000100:00100000:2.0:1787360099.580464:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064512 00000100:00100000:2.0:1787360099.580484:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787360099.580490:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596063616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580520:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596063616:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.580526:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787360099.580537:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787360099.580543:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596064000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580567:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596064000:12345-0@lo:400:kworker.0 Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.580572:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787360099.580583:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787360099.580588:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596064512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580613:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596064512:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360099.580619:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:2.0:1787360099.580638:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360099.580641:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360099.580663:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596063488:0@lo:400:kworker.0 00010000:00080000:2.0:1787360099.580675:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5f80 x1874182596064000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360099.580684:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596064000:0@lo:400:kworker.0 00010000:00080000:2.0:1787360099.580694:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2ec74000 x1874182596064512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360099.580702:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ec74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596064512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580722:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596063616:0@lo:400:kworker.0 00000100:00100000:2.0:1787360099.580731:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596064128:0@lo:400:kworker.0 00000001:00100000:1.0:1787360099.582811:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:1.0:1787360099.582818:0:8442:0:(genops.c:885:class_export_put()) final put ffff998a31314000/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:3.0:1787360099.582955:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a31314000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-OST0000 00000020:00000080:3.0:1787360099.583006:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a31315800 for lustre-OST0000 00010000:00010000:3.0:1787360100.474837:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360100.605704:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360100.605734:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596064640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360100.605823:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360100.606048:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064640 00000100:00100000:0.0:1787360100.606056:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064640 00000100:00100000:0.0:1787360100.606105:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787360100.606115:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596064640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360100.606147:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787360100.606213:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596064640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360100.606220:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360100.606435:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596064640:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787360101.308896:0:14072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:55:00 (1787360100) 00010000:00010000:0.0:1787360101.497938:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360101.626548:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596064896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360101.626573:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596064768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360101.626650:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360101.626696:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064768 00000100:00100000:3.0:1787360101.626705:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064768 00000100:00100000:2.0:1787360101.626815:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360101.626821:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787360101.626835:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596064768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360101.626872:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787360101.626946:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360101.626973:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596064896 00000100:00100000:1.0:1787360101.626978:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596064896 00000100:00100000:1.0:1787360101.627012:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787360101.627019:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596064896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360101.627040:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360101.627078:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596064896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360101.627086:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787360101.627107:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360101.627143:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596064896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360101.627195:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596064768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 363us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360101.627204:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787360101.630581:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596064768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787360102.524474:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360102.926701:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360102.926838:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997120 00000100:00100000:0.0:1787360102.926852:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997120 00000100:00100000:0.0:1787360102.927052:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1787360102.927067:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:11076:x1874182574997120:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360102.927093:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360102.927124:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72027f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eefec expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927298:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927316:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927332:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360102.927394:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787360102.927399:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360102.927449:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927626:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72027f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefec expref: 7 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927650:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefec expref: 6 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360102.927659:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712a00) 00010000:00010000:0.0:1787360102.927662:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360102.927666:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689400, rc 0) 00000100:00100000:0.0:1787360102.927760:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:11076:x1874182574997120:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 697us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.927769:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00080000:1.0:1787360102.928317:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360102.934120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360102.934329:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997248 00000100:00100000:3.0:1787360102.934342:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997248 00000100:00100000:3.0:1787360102.934418:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1787360102.934430:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:11077:x1874182574997248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360102.934457:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360102.934491:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee72028d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eeff3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934580:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934596:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934608:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934624:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934631:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934658:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934736:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934744:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934750:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360102.934795:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360102.934800:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360102.934836:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934848:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934855:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934862:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934868:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aaa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360102.934873:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934880:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934911:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712a00) 00010000:00010000:3.0:1787360102.934914:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360102.934919:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934926:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720294 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934942:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934949:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934955:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934960:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360102.934963:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934969:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934986:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff998902719c00) 00010000:00010000:3.0:1787360102.934988:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360102.934991:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.934997:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72029b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.935043:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee72028d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeff3 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.935056:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeff3 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.935065:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998902719e00) 00010000:00010000:3.0:1787360102.935067:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360102.935069:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aa000, rc 0) 00000100:00100000:3.0:1787360102.935176:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:11077:x1874182574997248:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 747us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360102.935185:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1787360102.942511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360102.942879:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997376 00000100:00100000:1.0:1787360102.942902:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997376 00000100:00100000:1.0:1787360102.942971:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360102.942993:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1121de3d-8714-4863-bc5d-127112ba378a+7:11077:x1874182574997376:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787360102.943107:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1121de3d-8714-4863-bc5d-127112ba378a+7:11077:x1874182574997376:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 Request processed in 116us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360102.943115:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360102.946968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360102.947262:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997632 00000100:00100000:3.0:1787360102.947276:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997632 00000100:00100000:3.0:1787360102.947355:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1787360102.947368:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:11077:x1874182574997632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360102.947403:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360102.947430:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7202a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4eeffa expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.947707:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.947725:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.947759:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.947992:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.948015:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.948028:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.948523:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350abc00/0x359a4e2aee7202be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.948533:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350abc00/0x359a4e2aee7202be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.948541:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350abc00/0x359a4e2aee7202be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360102.948552:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787360102.951458:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951475:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951483:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951490:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360102.951506:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951514:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951531:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998902719e00) 00010000:00010000:3.0:1787360102.951534:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360102.951538:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951544:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7202b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951558:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951564:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951569:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951574:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aaa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360102.951577:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951584:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951590:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff998902719c00) 00010000:00010000:3.0:1787360102.951592:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360102.951601:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951607:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7202b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951947:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7202a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeffa expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951962:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350abc00/0x359a4e2aee7202be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeffa expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360102.951969:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360102.951972:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360102.951974:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350abc00, rc 0) 00000100:00100000:3.0:1787360102.952352:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:11077:x1874182574997632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 4984us (5396us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787360102.952360:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:2.0:1787360102.957707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360102.957927:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997760 00000100:00100000:3.0:1787360102.957936:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997760 00000100:00100000:3.0:1787360102.957994:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:3.0:1787360102.958004:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:11077:x1874182574997760:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787360102.958125:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:11077:x1874182574997760:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360102.958133:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360102.960936:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360102.961011:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574997888 00000100:00100000:2.0:1787360102.961020:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574997888 00000100:00100000:2.0:1787360102.961105:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1787360102.961116:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:11077:x1874182574997888:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787360102.961316:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787360102.965436:0:11098:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4280us 00000040:00080000:1.0:1787360102.974180:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787360102.998001:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:11077:x1874182574997888:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 36879us (37066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.998023:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00010000:00010000:3.0:1787360103.545373:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360103.673329:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360103.673350:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596065024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360103.673416:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360103.673477:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065024 00000100:00100000:0.0:1787360103.673484:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065024 00000100:00100000:0.0:1787360103.673526:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787360103.673536:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596065024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360103.673566:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360103.673611:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596065024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.673617:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787360103.673659:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596065024:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787360103.993865:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787360104.297261:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360104.297295:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360104.297327:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360104.297351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360104.297404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360104.297435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998016 00000100:00100000:1.0:1787360104.297444:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998016 00000100:00100000:3.0:1787360104.297635:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998144 00000100:00100000:3.0:1787360104.297640:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998144 00000100:00100000:3.0:1787360104.297688:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998400 00000100:00100000:3.0:1787360104.297692:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998400 00000100:00100000:3.0:1787360104.297705:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998272 00000100:00100000:3.0:1787360104.297708:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998272 00000100:00100000:3.0:1787360104.297721:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:3.0:1787360104.297729:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182574998144:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360104.297917:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182574998144:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 187us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.297925:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 279 00000100:00100000:3.0:1787360104.297949:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998528 00000100:00100000:3.0:1787360104.297952:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998528 00000100:00100000:3.0:1787360104.297969:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 280 00000100:00100000:3.0:1787360104.297975:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574998400:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360104.298050:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574998400:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 74us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.298057:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 280 00000100:00100000:3.0:1787360104.298070:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:3.0:1787360104.298076:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574998272:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360104.298096:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182574998272:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.298101:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 281 00000100:00100000:3.0:1787360104.298111:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00100000:3.0:1787360104.298116:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574998528:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360104.298137:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182574998528:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.298153:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 282 00000100:00100000:1.0:1787360104.298346:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 381 00000100:00100000:1.0:1787360104.298356:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574998016:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360104.298389:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182574998016:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.298396:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 381 00000100:00080000:1.0:1787360104.298431:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360104.298435:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787360104.580703:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360104.699210:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360104.699244:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596065152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360104.699307:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.699376:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065152 00000100:00100000:2.0:1787360104.699383:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065152 00000100:00100000:2.0:1787360104.699434:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787360104.699443:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596065152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360104.699470:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360104.699511:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596065152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.699518:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787360104.699537:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787360104.699566:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edd5f80 x1874182596065152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360104.699603:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596065152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360104.699726:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360104.699737:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596065280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360104.699772:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360104.699801:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065280 00000100:00100000:0.0:1787360104.699805:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065280 00000100:00100000:0.0:1787360104.699833:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787360104.699839:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596065280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360104.699849:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360104.699889:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596065280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360104.699896:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1787360104.699929:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904177b80 x1874182596065280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360104.699943:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596065280:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787360104.700007:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360104.709525:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596065536:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709591:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709639:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596066048:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709663:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709683:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596066560:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709701:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709725:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787360104.709731:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596065664:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709752:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709768:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596066176:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709786:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709800:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596066688:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.709820:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.709846:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065536 00000100:00100000:2.0:1787360104.709854:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065536 00000100:00100000:2.0:1787360104.709899:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066048 00000100:00100000:2.0:1787360104.709902:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066048 00000100:00100000:2.0:1787360104.709925:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066560 00000100:00100000:2.0:1787360104.709928:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066560 00000100:00100000:2.0:1787360104.709939:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066176 00000100:00100000:2.0:1787360104.709941:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066176 00000100:00100000:2.0:1787360104.709952:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066688 00000100:00100000:2.0:1787360104.709955:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066688 00000100:00100000:2.0:1787360104.709969:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787360104.709986:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596065536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710032:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596065536:12345-0@lo:400:kworker.0 Request processed in 47us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710039:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787360104.710057:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787360104.710063:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596066048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710089:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596066048:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710094:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787360104.710106:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787360104.710112:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710138:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596066560:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710144:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787360104.710154:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787360104.710159:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596066176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710181:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596066176:12345-0@lo:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710187:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787360104.710196:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787360104.710200:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596066688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710219:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596066688:12345-0@lo:400:kworker.0 Request processed in 20us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710248:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787360104.710270:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065664 00000100:00100000:2.0:1787360104.710279:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065664 00000100:00100000:2.0:1787360104.710305:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787360104.710311:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596065664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710340:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596065664:12345-0@lo:400:kworker.0 Request processed in 30us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.710346:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1787360104.710362:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360104.710365:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360104.710389:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596065664:0@lo:400:kworker.0 00010000:00080000:2.0:1787360104.710401:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902917480 x1874182596066176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360104.710411:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596066176:0@lo:400:kworker.0 00010000:00080000:2.0:1787360104.710420:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890405a300 x1874182596066688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360104.710428:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596066688:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710437:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596065536:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710445:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596066048:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.710453:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596066560:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710571:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596065408:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710605:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.710627:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596065920:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710652:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.710670:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596066432:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710691:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.710712:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787360104.710718:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596065792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710740:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.710756:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596066304:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710775:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.710803:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065792 00000100:00100000:1.0:1787360104.710807:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065792 00000100:00100000:1.0:1787360104.710834:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787360104.710841:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596065792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710872:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596065792:12345-0@lo:400:kworker.0 Request processed in 33us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.710878:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787360104.710912:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065920 00000100:00100000:1.0:1787360104.710916:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065920 00000100:00100000:1.0:1787360104.710947:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360104.710953:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596065920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.710983:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596065920:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.710989:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360104.711007:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066432 00000100:00100000:1.0:1787360104.711010:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066432 00000100:00100000:1.0:1787360104.711040:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596066304 00000100:00100000:1.0:1787360104.711043:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596066304 00000100:00100000:1.0:1787360104.711062:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787360104.711068:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596066432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.711095:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596066432:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.711105:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787360104.711116:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787360104.711122:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596066304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.711144:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596066304:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.711150:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1787360104.711175:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360104.711193:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596065792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.711201:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596066304:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.711209:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596065920:0@lo:400:kworker.0 00000100:00100000:1.0:1787360104.711216:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596066432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.711310:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596065408 00000100:00100000:2.0:1787360104.711314:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596065408 00000100:00100000:2.0:1787360104.711348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1787360104.711355:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.711401:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596065408:12345-0@lo:400:kworker.0 Request processed in 47us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.711415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787360104.714794:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596065408:0@lo:400:kworker.0 00000100:00100000:2.0:1787360104.928941:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360104.929625:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998656 00000100:00100000:0.0:1787360104.929636:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998656 00000100:00100000:0.0:1787360104.929691:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:0.0:1787360104.929701:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:11119:x1874182574998656:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360104.929718:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360104.929737:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7202cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef001 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929798:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929812:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929824:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929839:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929847:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929853:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929909:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929925:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929932:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929938:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360104.929943:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929950:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929963:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712a00) 00010000:00010000:0.0:1787360104.929966:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360104.929970:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929976:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee7202d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929991:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.929997:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930004:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930009:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360104.930029:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930037:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930045:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff998a07c29b00) 00010000:00010000:0.0:1787360104.930048:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360104.930051:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930056:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee7202da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930096:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7202cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef001 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930107:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712a00) 00010000:00010000:0.0:1787360104.930109:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360104.930113:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7202cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef001 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.930124:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688800, rc 0) 00000100:00100000:0.0:1787360104.930191:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:11119:x1874182574998656:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 491us (1259us total) trans 0 rc 301/301 00000100:00100000:0.0:1787360104.930198:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:1.0:1787360104.942610:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360104.942689:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574998912 00000100:00100000:2.0:1787360104.942700:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574998912 00000100:00100000:2.0:1787360104.942759:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:2.0:1787360104.942781:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+9:11119:x1874182574998912:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:2.0:1787360104.942834:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360104.942862:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee720286 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefec expref: 9 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.942889:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a08712a00) 00010000:00010000:2.0:1787360104.942900:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360104.942960:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.942975:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.942985:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.942998:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943005:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943012:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943925:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943938:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943947:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360104.943963:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095cc99a9 reply state 000000001399ad04 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943973:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.943979:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360104.943982:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360104.943986:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787360104.943991:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787360104.943998:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944004:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944011:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944017:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360104.944021:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944041:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944050:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a3d37b900) 00010000:00010000:2.0:1787360104.944053:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360104.944057:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944062:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee7202e1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360104.944076:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095cc99a9 reply state 000000001399ad04 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944084:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.944091:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff998a3d37bf00) 00010000:00010000:2.0:1787360104.944093:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360104.944095:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787360104.944195:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+10:11119:x1874182574998912:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 1424us (1592us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787360104.944203:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:2.0:1787360105.065144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.065255:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999040 00000100:00100000:1.0:1787360105.065264:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999040 00000100:00100000:1.0:1787360105.065319:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1787360105.065330:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+10:11127:x1874182574999040:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:1.0:1787360105.065352:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.065373:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7202f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef008 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065434:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065452:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065463:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360105.065507:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360105.065511:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360105.065546:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065569:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7202f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef008 expref: 12 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065585:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef008 expref: 11 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.065592:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:1.0:1787360105.065607:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360105.065610:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70200, rc 0) 00000100:00100000:1.0:1787360105.065673:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+11:11127:x1874182574999040:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 344us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.065680:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:3.0:1787360105.161997:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.162089:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999168 00000100:00100000:1.0:1787360105.162098:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999168 00000100:00100000:1.0:1787360105.162152:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:1.0:1787360105.162162:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+11:11133:x1874182574999168:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360105.162180:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.162198:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720304 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef00f expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162460:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162474:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162484:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162495:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162502:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162508:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162599:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162607:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162613:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360105.162644:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787360105.162647:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360105.162681:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162692:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162698:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162704:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162723:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.162727:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162733:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162744:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:1.0:1787360105.162753:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.162758:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162764:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72030b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162777:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162781:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162786:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162791:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.162794:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162800:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162809:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff998a3d37bf00) 00010000:00010000:1.0:1787360105.162813:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.162816:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162821:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720312 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162845:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720304 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef00f expref: 13 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162870:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef00f expref: 12 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.162888:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360105.162890:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787360105.162893:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71a00, rc 0) 00000100:00100000:1.0:1787360105.163131:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+12:11133:x1874182574999168:12345-192.168.206.11@tcp:101:bash.0 Request processed in 968us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.163138:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:2.0:1787360105.174539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.174623:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999424 00000100:00100000:1.0:1787360105.174632:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999424 00000100:00100000:1.0:1787360105.174694:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:1.0:1787360105.174705:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+12:11133:x1874182574999424:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360105.174729:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.174750:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720320 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef016 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174851:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174866:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174876:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174905:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174926:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.174933:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360105.175262:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787360105.175373:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175382:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175389:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175414:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175421:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175427:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175433:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.175437:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175444:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175464:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360105.175467:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.175471:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175477:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360105.175489:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d702e8b8 reply state 00000000175eb636 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175498:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175503:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:1.0:1787360105.175505:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360105.175508:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787360105.175531:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720320 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175543:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.175550:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:1.0:1787360105.175552:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360105.175554:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70a00, rc 0) 00000100:00100000:1.0:1787360105.175610:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+15:11133:x1874182574999424:12345-192.168.206.11@tcp:101:bash.0 Request processed in 907us (1079us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787360105.175617:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1787360105.179434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.179949:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999552 00000100:00100000:1.0:1787360105.179959:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999552 00000100:00100000:1.0:1787360105.180068:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1787360105.180076:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182574999552:12345-192.168.206.11@tcp:8:bash.0 00010000:00080000:1.0:1787360105.180109:0:8770:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:1.0:1787360105.180139:0:8770:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee720343 00002000:00100000:1.0:1787360105.180152:0:8770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1121de3d-8714-4863-bc5d-127112ba378a/ffff998a1a516000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360105.180163:0:8770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360105.180464:0:8770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360105.180493:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998a1a511000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360105.180563:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182574999552:12345-192.168.206.11@tcp:8:bash.0 Request processed in 486us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.180571:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1787360105.188203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.188385:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999680 00000100:00100000:1.0:1787360105.188395:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999680 00000100:00100000:1.0:1787360105.188472:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787360105.188482:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182574999680:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360105.188498:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.188520:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef01d expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360105.188544:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360105.188562:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787360105.188567:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360105.188577:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.188616:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 7 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.188629:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70e00, rc 0) 00000100:00100000:1.0:1787360105.188689:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:0:x1874182574999680:12345-192.168.206.11@tcp:101:bash.0 Request processed in 208us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.188697:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00080000:2.0:1787360105.189187:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360105.196078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360105.196186:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999808 00000100:00100000:2.0:1787360105.196196:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999808 00000100:00100000:2.0:1787360105.196292:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:2.0:1787360105.196304:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:11133:x1874182574999808:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360105.196329:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360105.196349:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef024 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.196379:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.196388:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360105.196392:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360105.196397:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.196495:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.196509:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360105.196523:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1874182596066816:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360105.196612:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360105.205119:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1874182596066816:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360105.205156:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.205178:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041000, rc 0) 00000100:00100000:2.0:1787360105.205284:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:11133:x1874182574999808:12345-192.168.206.11@tcp:101:bash.0 Request processed in 8982us (9213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360105.205293:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:3.0:1787360105.206583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.206919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182574999936 00000100:00100000:1.0:1787360105.206928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182574999936 00010000:00010000:1.0:1787360105.206965:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360105.207010:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1787360105.207020:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182574999936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360105.207035:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360105.207064:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.207078:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.207100:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076a995fb/0x359a4e2aee72034a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef01d expref: 8 pid: 8450 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.207133:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360105.207137:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360105.207146:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.207157:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.207193:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360105.207213:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6518:1874182596066944:192.168.206.11@tcp:105: 00000100:00100000:1.0:1787360105.207389:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff998901f81480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360105.217970:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6518:1874182596066944:192.168.206.11@tcp:105: 00010000:00010000:1.0:1787360105.217995:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360105.218057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182574999936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 11037us (11478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.218068:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360105.221411:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.221572:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575000192 00000100:00100000:1.0:1787360105.221583:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575000192 00000100:00100000:1.0:1787360105.221640:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360105.221651:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:11133:x1874182575000192:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:1.0:1787360105.221945:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+16:11133:x1874182575000192:12345-192.168.206.11@tcp:35:bash.0 Request processed in 295us (542us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787360105.221968:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1787360105.329734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360105.329885:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575000448 00000100:00100000:0.0:1787360105.329895:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575000448 00000100:00100000:0.0:1787360105.329965:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360105.329976:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+16:11143:x1874182575000448:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360105.330019:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360105.330040:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef02b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360105.330140:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787360105.330267:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720358 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef02b expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.330281:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:0.0:1787360105.330283:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360105.330287:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef02b expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.330301:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689c00, rc 0) 00000100:00100000:0.0:1787360105.330360:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+17:11143:x1874182575000448:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 386us (637us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1787360105.330368:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:3.0:1787360105.333075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.333273:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575000704 00000100:00100000:1.0:1787360105.333283:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575000704 00000100:00100000:1.0:1787360105.333337:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360105.333347:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+17:11143:x1874182575000704:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360105.333567:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:11143:x1874182575000704:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 220us (499us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787360105.333576:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:2.0:1787360105.431517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.431870:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575000832 00000100:00100000:1.0:1787360105.431894:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575000832 00000100:00100000:1.0:1787360105.431969:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1787360105.431980:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+18:11150:x1874182575000832:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360105.432003:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.432022:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef032 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432292:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432307:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432316:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360105.432355:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787360105.432358:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360105.432390:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432414:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef032 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432431:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef032 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.432438:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360105.432441:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360105.432444:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:1.0:1787360105.432501:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+19:11150:x1874182575000832:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 523us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.432508:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1787360105.438115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.438239:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001088 00000100:00100000:1.0:1787360105.438248:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001088 00000100:00100000:1.0:1787360105.438304:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1787360105.438313:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:11150:x1874182575001088:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360105.438331:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.438350:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef039 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.438448:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72037b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.438461:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72037b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.438472:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72037b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360105.438497:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787360105.438597:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef039 expref: 22 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.438614:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72037b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef039 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.438623:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:1.0:1787360105.438626:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360105.438629:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71c00, rc 0) 00000100:00100000:1.0:1787360105.438689:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+21:11150:x1874182575001088:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 377us (583us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787360105.438697:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:0.0:1787360105.452360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.452451:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001344 00000100:00100000:1.0:1787360105.452461:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001344 00000100:00100000:1.0:1787360105.452523:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1787360105.452532:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+21:11150:x1874182575001344:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360105.452568:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360105.452587:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef040 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.452704:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.452717:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.452745:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360105.452758:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787360105.452935:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef040 expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.452953:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef040 expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.452961:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:1.0:1787360105.452964:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787360105.452967:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70e00, rc 0) 00000100:00100000:1.0:1787360105.453026:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+23:11150:x1874182575001344:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 496us (676us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787360105.453033:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1787360105.453961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.454308:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001472 00000100:00100000:1.0:1787360105.454316:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001472 00000100:00100000:0.0:1787360105.454661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360105.454674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:2399:x1874182575001472:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360105.454688:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360105.454708:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72037b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef039 expref: 23 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.454724:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:0.0:1787360105.454728:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360105.454801:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575001472:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 131us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360105.454809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360105.467680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.467761:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001600 00000100:00100000:1.0:1787360105.467769:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001600 00000100:00100000:1.0:1787360105.467818:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:1.0:1787360105.467827:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575001600:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:1.0:1787360105.467866:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.467894:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.467927:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360105.467931:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360105.467936:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.467969:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.467981:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 7 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360105.467995:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596067072:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360105.468398:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787360105.470852:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596067072:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360105.470893:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360105.471666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.471954:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001728 00000100:00100000:1.0:1787360105.471962:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001728 00002000:00100000:1.0:1787360105.472004:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9989039d2300 x1874182575001728/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:296/0 lens 504/0 e 0 to 0 dl 1787360116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360105.472015:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989039d2300 with x1874182575001728 ext(0->12) 00010000:00010000:1.0:1787360105.472022:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 8 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.472064:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 8 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360105.472072:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9989039d2300 00000100:00100000:1.0:1787360105.472104:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:1.0:1787360105.472114:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575001728:12345-192.168.206.11@tcp:4:lfs.0 00000001:00100000:3.0:1787360105.487712:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000100:00100000:1.0:1787360105.490693:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575001728:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 18572us (19021us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787360105.490707:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00002000:00100000:1.0:1787360105.490718:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9989039d2300 x1874182575001728/t4294967300(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:296/0 lens 504/448 e 0 to 0 dl 1787360116 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360105.490729:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989039d2300 with x1874182575001728 ext(0->12) 00010000:00010000:1.0:1787360105.490739:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.490757:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360105.490765:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9989039d2300 00000100:00100000:3.0:1787360105.499212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.499279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575001856 00000100:00100000:1.0:1787360105.499290:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575001856 00010000:00010000:1.0:1787360105.499328:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360105.499385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1787360105.499396:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575001856:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360105.499412:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787360105.499428:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787360105.499432:0:6517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787360105 00002000:00010000:1.0:1787360105.499434:0:6517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787360105 00002000:00010000:1.0:1787360105.499437:0:6517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787360105 00002000:00010000:1.0:1787360105.499439:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787360105.499445:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.499460:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.499482:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d66cf88/0x359a4e2aee720351 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef024 expref: 9 pid: 8448 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.499498:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360105.499503:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360105.499509:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.499519:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.499619:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360105.499679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575001856:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 284us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.499687:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00010000:00010000:2.0:1787360105.503756:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503776:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503806:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503815:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503823:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503831:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360105.503835:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503844:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503893:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.503901:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a533302/0x359a4e2aee72039e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360105.504014:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575001600:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 36181us (36335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360105.504023:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:3.0:1787360105.508838:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360105.508940:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575002112 00000100:00100000:2.0:1787360105.508950:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575002112 00000100:00100000:2.0:1787360105.509068:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1787360105.509079:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:11150:x1874182575002112:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:2.0:1787360105.509138:0:6535:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef040 expref: 22 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360105.510628:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787360105.510682:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787360105.512874:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1787360105.513015:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.513034:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.513264:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.513319:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 26 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.513335:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 26 pid: 6532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360105.513350:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596067200:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360105.513435:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360105.516723:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596067200:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360105.516753:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360105.519492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360105.519670:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575002240 00000100:00100000:0.0:1787360105.519680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575002240 00010000:00010000:0.0:1787360105.519721:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 27 pid: 6532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360105.519766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:0.0:1787360105.519776:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+27:2402:x1874182575002240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360105.519790:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360105.519797:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 27 pid: 6532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.519812:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 27 pid: 6532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.519845:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef016 expref: 27 pid: 6532 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.519863:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:0.0:1787360105.519867:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.519884:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.519918:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.520214:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360105.520310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+26:2402:x1874182575002240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 535us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360105.520318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00010000:00010000:2.0:1787360105.526651:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.526669:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360105.526783:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1787360105.527023:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787360105.527129:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596067328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787360105.527190:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360105.527300:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360105.528390:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596067328 00000100:00100000:0.0:1787360105.528402:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596067328 00000100:00100000:0.0:1787360105.528468:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787360105.528479:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596067328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787360105.528806:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596067328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 327us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360105.528814:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787360105.528917:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596067328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787360105.529093:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1787360105.529153:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596067456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787360105.529200:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360105.529302:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360105.529964:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596067456 00000100:00100000:1.0:1787360105.529971:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596067456 00000100:00100000:0.0:1787360105.530630:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787360105.530641:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596067456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787360105.530840:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1874182596067456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 199us (1639us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787360105.530848:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787360105.530931:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef03480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596067456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787360105.530988:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787360105.531025:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531049:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531058:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531064:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360105.531068:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531076:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531091:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:2.0:1787360105.531094:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787360105.531098:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360105.531104:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7203a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360105.531195:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787360105.531271:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787360105.531281:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383778054713ns, next at 384778052982ns, rc = 0 00000001:00080000:2.0:1787360105.531299:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787360105.531322:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a28ece700) 00010000:00010000:2.0:1787360105.531325:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787360105.531331:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720390 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef040 expref: 30 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360105.531654:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:11150:x1874182575002112:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 22577us (22824us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787360105.531663:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000020:00080000:2.0:1787360105.531666:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787360105.535218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360105.535278:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575002368 00000100:00100000:3.0:1787360105.535287:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575002368 00000100:00100000:3.0:1787360105.535337:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1787360105.535347:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:11150:x1874182575002368:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360105.535379:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360105.535401:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7203ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef047 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.535456:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7203ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef047 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.535478:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7203ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef047 expref: 30 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.535518:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360105.535521:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360105.535753:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350ab800, rc 0) 00000100:00100000:3.0:1787360105.535815:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+30:11150:x1874182575002368:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 468us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360105.535822:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1787360105.540077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360105.540157:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575002624 00000100:00100000:2.0:1787360105.540167:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575002624 00000100:00100000:2.0:1787360105.540220:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1787360105.540251:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20564850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+30:11150:x1874182575002624:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360105.540472:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20564850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+31:11150:x1874182575002624:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 223us (406us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787360105.540479:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00010000:00010000:3.0:1787360105.593720:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360105.671488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360105.671579:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575002880 00000100:00100000:0.0:1787360105.671588:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575002880 00000100:00100000:0.0:1787360105.671644:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1787360105.671654:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+31:11160:x1874182575002880:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360105.671676:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360105.671696:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7203b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef04e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360105.671803:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787360105.671901:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7203b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef04e expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.671915:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:0.0:1787360105.671917:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360105.671922:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee7203b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef04e expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.671936:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688800, rc 0) 00000100:00100000:0.0:1787360105.671993:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:11160:x1874182575002880:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 341us (513us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1787360105.672001:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:2.0:1787360105.675909:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.676030:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575003008 00000100:00100000:1.0:1787360105.676039:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575003008 00000100:00100000:1.0:1787360105.676094:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:1.0:1787360105.676104:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+32:11160:x1874182575003008:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:1.0:1787360105.676176:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676193:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676203:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676213:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676220:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676265:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676338:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676357:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676364:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360105.676561:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676574:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676580:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676586:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676591:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.676594:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676601:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676613:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360105.676616:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.676620:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676626:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7203c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676645:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676652:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676658:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676662:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.676665:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676671:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676679:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:1.0:1787360105.676682:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.676685:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676690:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7203c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676699:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676705:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676710:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676722:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360105.676725:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676730:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676737:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360105.676739:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360105.676741:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360105.676746:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7203cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360105.676910:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+32:11160:x1874182575003008:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 805us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360105.676918:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1787360105.686333:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.686461:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575003264 00000100:00100000:1.0:1787360105.686471:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575003264 00000100:00100000:1.0:1787360105.686573:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:1.0:1787360105.686585:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:11160:x1874182575003264:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360105.686793:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+33:11160:x1874182575003264:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 210us (468us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787360105.686800:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360105.721886:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596067584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360105.721955:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360105.722078:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596067584 00000100:00100000:0.0:1787360105.722086:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596067584 00000100:00100000:0.0:1787360105.722133:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787360105.722143:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596067584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360105.722175:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787360105.722247:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596067584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360105.722254:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787360105.722536:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596067584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360105.743207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360105.743324:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575003520 00000100:00100000:3.0:1787360105.743334:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575003520 00000100:00100000:3.0:1787360105.743394:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:3.0:1787360105.743405:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+33:11163:x1874182575003520:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360105.743427:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360105.743447:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7203d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef055 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743518:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743542:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743553:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743580:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743587:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743593:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743709:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743718:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743725:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360105.743733:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787360105.743805:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743813:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743820:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743838:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360105.743842:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743860:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743872:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360105.743884:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360105.743889:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743895:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7203dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743910:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743916:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743921:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743927:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aa200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360105.743930:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743936:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.743943:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:3.0:1787360105.743945:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360105.744407:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.744427:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee7203e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.744476:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee7203d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 36 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.744489:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 35 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360105.744496:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360105.744498:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360105.744500:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aba00, rc 0) 00000100:00100000:3.0:1787360105.744798:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+35:11163:x1874182575003520:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1393us (1598us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787360105.744808:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787360105.751171:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360105.751475:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575003648 00000100:00100000:1.0:1787360105.751484:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575003648 00000100:00100000:0.0:1787360105.751994:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787360105.752008:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+35:11163:x1874182575003648:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1787360105.752073:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752105:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752116:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752157:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752163:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752171:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752176:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360105.752180:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752187:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752198:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360105.752201:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360105.752206:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360105.752213:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee7203f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360105.752354:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+35:11163:x1874182575003648:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 348us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360105.752376:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787360105.761589:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360105.761756:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575003904 00000100:00100000:2.0:1787360105.761765:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575003904 00000100:00100000:2.0:1787360105.761818:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360105.761829:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:11163:x1874182575003904:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360105.762053:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+36:11163:x1874182575003904:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 224us (534us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787360105.762075:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360106.068191:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360106.071449:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575004160 00000100:00100000:1.0:1787360106.071480:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575004160 00000100:00080000:2.0:1787360106.071685:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360106.072274:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1787360106.072290:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+36:11194:x1874182575004160:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1787360106.072316:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360106.072340:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef05c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.072447:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.072462:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.072475:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360106.072484:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787360106.072626:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef05c expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.072644:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef05c expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.072652:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360106.072655:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360106.072658:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360106.073163:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+38:11194:x1874182575004160:12345-192.168.206.11@tcp:101:cat.0 Request processed in 877us (4977us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787360106.073173:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1787360106.080069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360106.080150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575004288 00000100:00100000:1.0:1787360106.080158:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575004288 00000100:00100000:1.0:1787360106.080257:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:1.0:1787360106.080268:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+38:2400:x1874182575004288:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360106.080282:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360106.080310:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef05c expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.080327:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360106.080332:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360106.080381:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+37:2400:x1874182575004288:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.080388:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787360106.082067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360106.082597:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575004544 00000100:00100000:2.0:1787360106.082606:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575004544 00000100:00100000:2.0:1787360106.082664:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360106.082675:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+37:11194:x1874182575004544:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:2.0:1787360106.083184:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+38:11194:x1874182575004544:12345-192.168.206.11@tcp:35:cat.0 Request processed in 509us (1121us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1787360106.083192:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360106.170645:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360106.170814:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575004800 00000100:00100000:0.0:1787360106.170823:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575004800 00000100:00100000:0.0:1787360106.170897:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1787360106.170908:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:11200:x1874182575004800:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:0.0:1787360106.170930:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.170934:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787360106.170960:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72036d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef032 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.170978:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:0.0:1787360106.170983:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360106.170997:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720415 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef063 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.171499:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.171516:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 38 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.171525:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.171556:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 38 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.171726:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 38 pid: 11098 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.171741:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989039d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596067712:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360106.171852:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2064ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360106.182407:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360106.183014:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989039d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596067712:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360106.183050:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.184033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575004928 00000100:00100000:1.0:1787360106.184043:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575004928 00010000:00010000:1.0:1787360106.184083:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 39 pid: 11098 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.184124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:1.0:1787360106.184135:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+39:2400:x1874182575004928:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360106.184148:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360106.184155:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 39 pid: 11098 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184168:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 39 pid: 11098 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184208:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7203eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef055 expref: 39 pid: 11098 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184277:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360106.184283:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184292:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184300:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.184328:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360106.184382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:2400:x1874182575004928:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 248us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.184390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00010000:00010000:0.0:1787360106.185118:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.185128:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.185146:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787360106.185329:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee720415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.185347:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.185355:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360106.185358:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360106.185361:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689400, rc 0) 00000100:00100000:0.0:1787360106.185403:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:11200:x1874182575004800:12345-192.168.206.11@tcp:101:dd.0 Request processed in 14496us (14767us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787360106.185410:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1787360106.192415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360106.192563:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575005056 00000100:00100000:1.0:1787360106.192577:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575005056 00000100:00100000:1.0:1787360106.192655:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:1.0:1787360106.192668:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+38:11200:x1874182575005056:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:1.0:1787360106.192701:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360106.192727:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72042a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef06a expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192769:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192797:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192809:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192965:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee72042a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 40 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192986:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 39 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.192995:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360106.192998:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360106.193002:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71400, rc 0) 00000100:00100000:1.0:1787360106.193079:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+39:11200:x1874182575005056:12345-192.168.206.11@tcp:101:dd.0 Request processed in 414us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.193087:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:1.0:1787360106.196680:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.199770:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575005312 00000100:00100000:3.0:1787360106.199789:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575005312 00000100:00100000:3.0:1787360106.199901:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:3.0:1787360106.199913:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+39:11200:x1874182575005312:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:3.0:1787360106.200205:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.200267:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.200280:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360106.200355:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1787360106.200384:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008af94b6c reply state 00000000eed16ed3 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.200398:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.200407:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.200410:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360106.200415:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360106.200550:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+42:11200:x1874182575005312:12345-192.168.206.11@tcp:36:dd.0 Request processed in 637us (3882us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1787360106.200558:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000020:00080000:3.0:1787360106.200564:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787360106.497979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360106.498093:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575005440 00000100:00100000:0.0:1787360106.498110:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575005440 00000100:00100000:0.0:1787360106.498827:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:0.0:1787360106.498854:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+42:11214:x1874182575005440:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:0.0:1787360106.498896:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.498923:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72043f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef071 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499010:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499028:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499041:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499054:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499061:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499068:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499195:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499218:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499260:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499305:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.499320:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 43 pid: 6531 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.499335:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596067840:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360106.499605:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2064eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360106.503507:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360106.503684:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596067840:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360106.503724:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.504982:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575005696 00000100:00100000:3.0:1787360106.504999:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575005696 00000100:00100000:3.0:1787360106.505113:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:3.0:1787360106.505125:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+44:6171:x1874182575005696:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787360106.505755:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+45:6171:x1874182575005696:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 628us (2262us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787360106.505764:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:1.0:1787360106.509130:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360106.509356:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575005824 00000100:00100000:0.0:1787360106.509380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575005824 00010000:00010000:0.0:1787360106.509436:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 45 pid: 6531 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.509483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1787360106.509496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+45:2400:x1874182575005824:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360106.509748:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360106.509760:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 45 pid: 6531 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509778:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 45 pid: 6531 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509830:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72041c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef063 expref: 45 pid: 6531 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360106.509866:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509886:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.509977:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360106.510055:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+44:2400:x1874182575005824:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 561us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.510064:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00010000:00010000:3.0:1787360106.510719:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.510731:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.510804:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787360106.510819:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360106.510947:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.510966:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.510978:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.510986:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.510993:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511000:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360106.511005:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511014:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511029:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360106.511032:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.511036:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511043:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee720446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511061:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511079:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511085:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511090:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360106.511093:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511098:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511108:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:3.0:1787360106.511110:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.511114:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511121:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee72044d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.511166:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72043f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef071 expref: 44 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.513088:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef071 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.513109:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.513112:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360106.513137:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefc00, rc 0) 00000100:00100000:3.0:1787360106.513948:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+43:11214:x1874182575005440:12345-192.168.206.11@tcp:101:stat.0 Request processed in 15101us (15971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.513962:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360106.575819:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.576591:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575006080 00000100:00100000:3.0:1787360106.576607:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575006080 00000100:00100000:3.0:1787360106.576691:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:3.0:1787360106.576704:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+43:11220:x1874182575006080:12345-192.168.206.11@tcp:36:truncate.0 00010000:00010000:3.0:1787360106.577045:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360106.577082:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef071 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.577107:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.577113:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360106.577408:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.577428:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.577439:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360106.577492:0:11098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787360106.577582:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb49bbc9 reply state 000000007b5ff00a transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.577598:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.577627:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.577629:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360106.577633:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360106.578031:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+45:11220:x1874182575006080:12345-192.168.206.11@tcp:36:truncate.0 Request processed in 1326us (2222us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787360106.578040:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000020:00080000:3.0:1787360106.578047:0:11098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787360106.617415:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360106.745830:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360106.746839:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360106.746886:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596067968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360106.746998:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360106.747327:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596067968 00000100:00100000:2.0:1787360106.747338:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596067968 00000100:00100000:2.0:1787360106.747425:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787360106.747438:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596067968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360106.747478:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360106.747738:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596067968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 302us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.747747:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787360106.747808:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596067968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787360106.749755:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360106.749904:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596068096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360106.750007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360106.750219:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596068096 00000100:00100000:2.0:1787360106.750248:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596068096 00000100:00100000:2.0:1787360106.750335:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787360106.750347:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596068096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360106.750378:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360106.750451:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596068096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.750459:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1787360106.750616:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360106.750925:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596068096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360106.773447:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360106.776359:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575006208 00000100:00100000:0.0:1787360106.776380:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575006208 00000100:00100000:0.0:1787360106.776484:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:0.0:1787360106.776496:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+45:11234:x1874182575006208:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:0.0:1787360106.776535:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.776692:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720462 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef078 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776782:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776798:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776814:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776828:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776836:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.776844:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.778038:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.778062:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.778072:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.778129:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787360106.778135:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360106.779706:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779758:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779771:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779778:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779785:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779792:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360106.779797:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779806:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779823:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:0.0:1787360106.779826:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.779831:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779837:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720469 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.779854:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781753:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781788:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781794:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360106.781800:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781809:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781830:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:0.0:1787360106.781833:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.781838:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781844:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781939:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720462 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 47 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781969:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 46 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.781977:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360106.781979:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360106.781982:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeec00, rc 0) 00000100:00100000:0.0:1787360106.782082:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+46:11234:x1874182575006208:12345-192.168.206.11@tcp:101:stat.0 Request processed in 5585us (8647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.782102:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360106.870595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.871604:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575006464 00000100:00100000:3.0:1787360106.871623:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575006464 00000100:00100000:3.0:1787360106.871721:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:3.0:1787360106.871735:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+46:11244:x1874182575006464:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360106.871763:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360106.871789:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72047e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef07f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.872124:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787360106.872293:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72047e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef07f expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.872312:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:3.0:1787360106.872315:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360106.872321:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee72047e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef07f expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.872338:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350ab400, rc 0) 00000100:00100000:3.0:1787360106.873977:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+47:11244:x1874182575006464:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 2228us (3443us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787360106.874026:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:1.0:1787360106.881369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360106.881640:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575006720 00000100:00100000:2.0:1787360106.881653:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575006720 00000100:00100000:2.0:1787360106.881728:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:2.0:1787360106.881741:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+47:11244:x1874182575006720:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360106.882259:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+48:11244:x1874182575006720:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 485us (880us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1787360106.882271:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:0.0:1787360106.952729:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360106.952877:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575006976 00000100:00100000:1.0:1787360106.952916:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575006976 00000100:00100000:1.0:1787360106.952989:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360106.953002:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+48:11250:x1874182575006976:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360106.953034:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360106.953060:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72048c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef086 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.953283:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.953302:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 49 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.953313:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.953359:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 49 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.953374:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 49 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.953390:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596068224:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360106.953505:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360106.957532:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596068224:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360106.957573:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.962184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360106.962808:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575007104 00000100:00100000:1.0:1787360106.962834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575007104 00010000:00010000:1.0:1787360106.962907:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 50 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.962980:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1787360106.962992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+50:2400:x1874182575007104:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360106.963011:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360106.963020:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 50 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963035:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 50 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963064:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720477 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef078 expref: 50 pid: 6532 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963085:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360106.963092:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963105:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963113:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.963159:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360106.963276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+49:2400:x1874182575007104:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 285us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.963285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00010000:00010000:0.0:1787360106.964493:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964512:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.964552:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787360106.964746:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee72048c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 50 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964771:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 49 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964781:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360106.964784:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360106.964788:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:0.0:1787360106.964866:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+49:11250:x1874182575006976:12345-192.168.206.11@tcp:101:bash.0 Request processed in 11865us (12150us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787360106.964886:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:0.0:1787360106.969394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.969490:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575007360 00000100:00100000:3.0:1787360106.969503:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575007360 00000100:00100000:3.0:1787360106.969591:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:3.0:1787360106.969604:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+49:11250:x1874182575007360:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:3.0:1787360106.969931:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.969953:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.969968:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360106.970029:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787360106.970053:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079fdf396 reply state 0000000084f2c7bd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.970068:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.970076:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.970079:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360106.970083:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360106.970201:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+52:11250:x1874182575007360:12345-192.168.206.11@tcp:36:bash.0 Request processed in 599us (821us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787360106.970273:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000020:00080000:3.0:1787360106.970279:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787360106.975698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.975889:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575007488 00000100:00100000:3.0:1787360106.976006:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575007488 00000100:00100000:3.0:1787360106.976133:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:3.0:1787360106.976147:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+52:11250:x1874182575007488:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360106.976179:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360106.976205:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef08d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.976401:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.976420:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 53 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.976430:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.976475:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 53 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.976491:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 53 pid: 11098 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.976508:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596068352:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360106.976685:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360106.979356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360106.979507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575007616 00000100:00100000:0.0:1787360106.979612:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575007616 00000100:00100000:3.0:1787360106.979613:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596068352:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360106.979647:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979662:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 54 pid: 11098 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.979725:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:0.0:1787360106.979737:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+54:2399:x1874182575007616:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360106.979757:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360106.979766:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 54 pid: 11098 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979778:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 54 pid: 11098 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979805:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720493 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef086 expref: 54 pid: 11098 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979834:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360106.979840:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979860:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979879:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.979911:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360106.979979:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.979981:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+53:2399:x1874182575007616:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 245us (636us total) trans 0 rc 0/0 00010000:00010000:3.0:1787360106.979987:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.980059:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787360106.980064:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360106.980088:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.980126:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef08d expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.980143:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef08d expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.980151:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360106.980154:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360106.980157:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a350aba00, rc 0) 00000100:00100000:3.0:1787360106.980184:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+53:11250:x1874182575007488:12345-192.168.206.11@tcp:101:bash.0 Request processed in 4042us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.980192:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:0.0:1787360106.980344:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1787360106.983094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360106.983275:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575007872 00000100:00100000:3.0:1787360106.983287:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575007872 00000100:00100000:3.0:1787360106.983371:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:3.0:1787360106.983404:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20565850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+52:11250:x1874182575007872:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:3.0:1787360106.983702:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20565850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+53:11250:x1874182575007872:12345-192.168.206.11@tcp:35:bash.0 Request processed in 300us (621us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787360106.983710:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000040:00080000:0.0:1787360107.065974:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787360107.070215:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360107.097962:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360107.098123:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575008128 00000100:00100000:0.0:1787360107.098138:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575008128 00000100:00100000:0.0:1787360107.098217:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1787360107.098257:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+53:11260:x1874182575008128:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360107.098288:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360107.098314:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef094 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360107.098457:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787360107.098604:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef094 expref: 55 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.098620:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:0.0:1787360107.098623:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360107.098629:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef094 expref: 55 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.098645:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeee00, rc 0) 00000100:00100000:0.0:1787360107.098728:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+54:11260:x1874182575008128:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 502us (782us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787360107.098736:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:1.0:1787360107.101926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.102087:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575008256 00000100:00100000:3.0:1787360107.102099:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575008256 00000100:00100000:3.0:1787360107.102173:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:3.0:1787360107.102186:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+54:11260:x1874182575008256:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:3.0:1787360107.102322:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102344:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102358:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102415:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102425:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102433:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102537:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102559:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102567:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360107.102628:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102643:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102651:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102658:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102665:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aa400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.102670:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102679:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102694:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360107.102698:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.102703:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102709:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa400/0x359a4e2aee7204c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102732:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102737:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102743:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102749:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.102751:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102757:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102766:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:3.0:1787360107.102768:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.102772:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102778:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102791:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102797:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102803:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102814:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.102817:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102823:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102832:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360107.102834:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.102837:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.102843:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360107.103168:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+54:11260:x1874182575008256:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 980us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.103178:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:1.0:1787360107.105968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.106165:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575008512 00000100:00100000:3.0:1787360107.106178:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575008512 00000100:00100000:3.0:1787360107.106328:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:3.0:1787360107.106341:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+54:11260:x1874182575008512:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360107.118313:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+55:11260:x1874182575008512:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 11945us (12398us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787360107.118332:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360107.170050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.170180:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575008768 00000100:00100000:3.0:1787360107.170194:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575008768 00000100:00100000:3.0:1787360107.170314:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:3.0:1787360107.170328:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+55:11263:x1874182575008768:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360107.170361:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360107.170405:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef09b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170545:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170563:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170576:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170590:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170598:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170605:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170749:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee7204ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170760:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee7204ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.170767:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee7204ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360107.170779:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787360107.171392:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171412:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171434:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171440:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.171445:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171453:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171469:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360107.171472:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.171476:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171483:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee7204e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171501:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171507:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171526:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171532:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.171535:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171551:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171559:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:3.0:1787360107.171562:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.171565:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171571:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7204e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171626:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee7204d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef09b expref: 58 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171641:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee7204ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef09b expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.171648:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360107.171650:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360107.171652:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9a00, rc 0) 00000100:00100000:3.0:1787360107.171752:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+57:11263:x1874182575008768:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1426us (1715us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787360107.171762:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:1.0:1787360107.178266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360107.178312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360107.178588:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575008896 00000100:00100000:0.0:1787360107.178602:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575008896 00000100:00100000:0.0:1787360107.178683:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:0.0:1787360107.178696:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+57:11263:x1874182575008896:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1787360107.178786:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178825:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178838:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178907:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178916:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178923:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178930:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360107.178935:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178944:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178958:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360107.178962:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360107.178968:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.178974:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee7204fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360107.179063:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+57:11263:x1874182575008896:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 368us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360107.179078:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1787360107.182125:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575009024 00000100:00100000:2.0:1787360107.182145:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575009024 00000100:00100000:2.0:1787360107.182284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360107.182297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+57:2401:x1874182575009024:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360107.182316:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360107.182351:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee7204ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef09b expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.182390:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:2.0:1787360107.182396:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360107.182485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+56:2401:x1874182575009024:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 190us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360107.182494:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:0.0:1787360107.191089:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360107.192736:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575009280 00000100:00100000:2.0:1787360107.192757:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575009280 00000100:00100000:2.0:1787360107.192914:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1787360107.192938:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+56:11263:x1874182575009280:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360107.193282:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+57:11263:x1874182575009280:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 346us (2206us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787360107.193293:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360107.311636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.311730:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575009536 00000100:00100000:3.0:1787360107.311745:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575009536 00000100:00100000:3.0:1787360107.311888:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:3.0:1787360107.311910:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+57:11281:x1874182575009536:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:3.0:1787360107.311959:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360107.311985:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720503 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.312113:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72050a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.312131:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72050a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.312144:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72050a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360107.312157:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787360107.312319:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720503 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a2 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.312343:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72050a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a2 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.312353:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360107.312368:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787360107.312372:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8800, rc 0) 00000100:00100000:3.0:1787360107.312458:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+59:11281:x1874182575009536:12345-192.168.206.11@tcp:101:cat.0 Request processed in 550us (836us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787360107.312466:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:3.0:1787360107.340008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360107.340285:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575009664 00000100:00100000:1.0:1787360107.340298:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575009664 00000100:00100000:1.0:1787360107.340392:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:1.0:1787360107.340406:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+59:11282:x1874182575009664:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360107.340438:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360107.340467:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720518 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0a9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340574:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340591:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340605:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360107.340663:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787360107.340668:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360107.340691:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340751:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720518 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a9 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340775:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a9 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.340784:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360107.340787:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360107.340792:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360107.341133:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11282:x1874182575009664:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 730us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.341143:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:1.0:1787360107.347392:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360107.348677:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010048 00000100:00100000:2.0:1787360107.348697:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010048 00000100:00100000:2.0:1787360107.348860:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787360107.348883:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+60:11282:x1874182575010048:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360107.349295:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+61:11282:x1874182575010048:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 414us (1914us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787360107.349305:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360107.352210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.352661:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010176 00000100:00100000:3.0:1787360107.352673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010176 00000100:00100000:3.0:1787360107.352808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:3.0:1787360107.353037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+61:11282:x1874182575010176:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:3.0:1787360107.353062:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787360107.353095:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aba00/0x359a4e2aee7204af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef08d expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.353121:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72050a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a2 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.353136:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab800/0x359a4e2aee7203ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef047 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.353146:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360107.353152:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360107.353320:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+58:11282:x1874182575010176:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 405us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.353330:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360107.356039:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.356129:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010304 00000100:00100000:3.0:1787360107.356141:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010304 00000100:00100000:3.0:1787360107.356352:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:3.0:1787360107.356375:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+58:11282:x1874182575010304:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:3.0:1787360107.356715:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.356737:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.356750:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360107.357300:0:9449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360107.361915:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787360107.362142:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787360107.362319:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+58:11282:x1874182575010304:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 5940us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.362334:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:0.0:1787360107.386295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360107.386474:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010432 00000100:00100000:3.0:1787360107.386487:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010432 00000100:00100000:3.0:1787360107.386572:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:3.0:1787360107.386584:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+58:11284:x1874182575010432:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360107.386611:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360107.386637:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72052d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0b0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386720:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386737:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386749:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386762:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386769:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.386797:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387129:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387141:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387149:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360107.387205:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787360107.387211:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360107.387268:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387282:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387291:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387297:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387304:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387311:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.387316:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387334:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387347:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360107.387350:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.387366:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387373:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387391:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387397:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387403:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387408:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360107.387411:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387417:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387424:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:3.0:1787360107.387427:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.387430:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387446:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72053b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387482:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee72052d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387497:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.387505:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360107.387508:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360107.387523:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9000, rc 0) 00000100:00100000:3.0:1787360107.387609:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+59:11284:x1874182575010432:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1027us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.387619:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00010000:00010000:0.0:1787360107.644489:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360108.089913:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787360108.089921:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360108.089958:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787360108.089965:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360108.090160:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596068480:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787360108.090479:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a012ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360108.110796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.110886:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010560 00000100:00100000:0.0:1787360108.110895:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010560 00000100:00100000:0.0:1787360108.110962:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:0.0:1787360108.110972:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11295:x1874182575010560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787360108.111002:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787360108.111109:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11295:x1874182575010560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 139us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.111117:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00080000:1.0:1787360108.111285:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360108.117519:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596068480:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360108.121881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.122705:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010688 00000100:00100000:3.0:1787360108.122718:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010688 00000100:00100000:3.0:1787360108.122785:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:3.0:1787360108.122797:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+59:11295:x1874182575010688:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.122888:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.122904:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.122918:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.122976:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.122984:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.122991:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123018:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123036:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123368:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360108.123412:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787360108.123416:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360108.123428:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123440:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123454:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123461:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123467:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.123472:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123480:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123493:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360108.123496:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.123499:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123506:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720549 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123518:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.123524:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124353:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124359:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.124369:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124377:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124388:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff998902719c00) 00010000:00010000:3.0:1787360108.124391:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.124394:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124399:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720550 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124418:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124424:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124429:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124434:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.124436:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124441:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124447:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360108.124449:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.124458:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.124463:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.125652:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+59:11295:x1874182575010688:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 2849us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.125664:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 79 00000001:00080000:3.0:1787360108.127141:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1787360108.127187:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787360108.127204:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998903478c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787360108.127209:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a0feaea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998903478180 00000020:00080000:3.0:1787360108.127212:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a0feae600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998904195800 00000020:00080000:3.0:1787360108.127272:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787360108.127428:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787360108.127491:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127503:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127522:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127536:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127540:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127559:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127576:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff998a3d37bf00) 00010000:00010000:1.0:1787360108.127579:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127583:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127591:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7202e8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127609:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127616:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127623:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127628:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127631:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127637:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127645:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360108.127647:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127650:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127665:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7202ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127680:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127687:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127693:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127698:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127701:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127707:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127715:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ece900) 00010000:00010000:1.0:1787360108.127718:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127720:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127726:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72032e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127741:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127746:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127757:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127762:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aaa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127765:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127771:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127779:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360108.127781:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127784:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127790:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aaa00/0x359a4e2aee720438 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127800:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127807:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127812:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127817:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aa200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127820:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127836:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127844:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360108.127846:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127849:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127855:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa200/0x359a4e2aee72045b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127876:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127883:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127889:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127894:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.127897:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127904:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127912:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:1.0:1787360108.127914:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.127917:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.127932:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350ab400/0x359a4e2aee7204a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.128872:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596068608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787360108.128939:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360108.128987:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596068608 00000100:00100000:1.0:1787360108.128994:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596068608 00000100:00100000:1.0:1787360108.129122:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360108.129133:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596068608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787360108.129158:0:8770:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1787360108.129189:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a88f369, atime: 0x6a88f369, ctime: 0x6a88f369, blocks: 0x8 00010000:00010000:1.0:1787360108.129197:0:8770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129212:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1787360108.129217:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360108.129242:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129259:0:8770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129268:0:8770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129275:0:8770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129300:0:8770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360108.129419:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596068608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 288us (479us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787360108.129427:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787360108.129446:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787360108.129456:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360108.129461:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129469:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360108.129473:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129482:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129496:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.129503:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee72055e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.130729:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360108.130732:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360108.130734:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787360108.130769:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998903b3f100/2, rc 0, transno 4294967302 00000100:00100000:1.0:1787360108.130784:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596068608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787360108.144562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.144909:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575010944 00000100:00100000:3.0:1787360108.144918:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575010944 00000100:00100000:3.0:1787360108.144961:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:3.0:1787360108.144970:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+12:11295:x1874182575010944:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.144989:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.145006:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720565 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0b7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145100:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145114:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145136:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360108.145148:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787360108.145221:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145248:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145256:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145261:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.145266:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145273:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145286:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360108.145289:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360108.145293:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145300:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72056c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145334:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720565 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b7 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145354:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360108.145357:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360108.145361:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720565 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b7 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.145371:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8600, rc 0) 00000100:00100000:3.0:1787360108.145420:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575010944:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 451us (868us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1787360108.145428:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:1.0:1787360108.152942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.153022:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575011072 00000100:00100000:0.0:1787360108.153031:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575011072 00000100:00100000:0.0:1787360108.153091:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:0.0:1787360108.153102:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575011072:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787360108.153136:0:11098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787360108.153275:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575011072:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 174us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.153283:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:0.0:1787360108.163429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.165671:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575011328 00000100:00100000:3.0:1787360108.165683:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575011328 00000100:00100000:3.0:1787360108.165772:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:3.0:1787360108.165783:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575011328:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.165801:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.165804:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787360108.165828:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72051f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0a9 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.165844:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360108.165848:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360108.165861:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee72057a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0be expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787360108.166271:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787360108.166416:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720581 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.166435:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.166445:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.166494:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee72057a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0be expref: 15 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.166519:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0be expref: 14 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.166643:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360108.166645:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360108.166648:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9600, rc 0) 00000100:00100000:3.0:1787360108.166709:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575011328:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 928us (3288us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787360108.166718:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:0.0:1787360108.176490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.176623:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575011584 00000100:00100000:3.0:1787360108.176633:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575011584 00000100:00100000:3.0:1787360108.176688:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:3.0:1787360108.176698:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575011584:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.176749:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360108.176774:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee720581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0be expref: 14 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176793:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360108.176808:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360108.176829:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176841:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176850:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176874:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176882:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176889:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176932:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176939:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176946:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176953:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.176957:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176965:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176979:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360108.176982:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.176986:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.176992:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee72058f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177003:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177009:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177015:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177019:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.177022:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177028:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177035:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf398b235 (ffff998902719300) 00010000:00010000:3.0:1787360108.177037:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.177040:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.177046:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720596 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf398b235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.177124:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575011584:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 426us (641us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360108.177131:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:1.0:1787360108.183711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.183834:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575011712 00000100:00100000:3.0:1787360108.183844:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575011712 00000100:00100000:3.0:1787360108.183905:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:3.0:1787360108.183916:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+13:11295:x1874182575011712:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.183935:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.183955:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee72059d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0c5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.183988:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.184001:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.184012:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.184111:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee72059d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.184127:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.184136:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:3.0:1787360108.184144:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787360108.184148:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8600, rc 0) 00000100:00100000:3.0:1787360108.184202:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575011712:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 288us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.184210:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 84 00000100:00100000:3.0:1787360108.192682:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.192752:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575011968 00000100:00100000:0.0:1787360108.192761:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575011968 00000100:00100000:0.0:1787360108.192816:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:0.0:1787360108.192826:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575011968:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.192911:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.192928:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.192940:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360108.193086:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787360108.193095:0:9449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386439868753ns, next at 387439866773ns, rc = 0 00000004:00010000:0.0:1787360108.193140:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c122aab8 reply state 00000000b27baa4e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.193153:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.193161:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:0.0:1787360108.193164:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787360108.193167:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360108.193281:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+16:11295:x1874182575011968:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 454us (608us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787360108.193290:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:0.0:1787360108.195387:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.198541:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012096 00000100:00100000:2.0:1787360108.198572:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012096 00000100:00100000:2.0:1787360108.198642:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:2.0:1787360108.198653:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+16:11295:x1874182575012096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.198677:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360108.198697:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0cc expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.198747:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 17 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.198761:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 17 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.198778:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:2.0:1787360108.198781:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360108.198784:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040a00, rc 0) 00000100:00100000:2.0:1787360108.198844:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+17:11295:x1874182575012096:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 193us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.198851:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:2.0:1787360108.203525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.203673:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012224 00000100:00100000:3.0:1787360108.203683:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012224 00000100:00100000:3.0:1787360108.203726:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1787360108.203734:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1874182575012224:12345-192.168.206.11@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787360108.203765:0:8447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:3.0:1787360108.203794:0:8447:0:(genops.c:1385:class_connect()) connect: client 1121de3d-8714-4863-bc5d-127112ba378a, cookie 0x359a4e2aee7205b9 00002000:00100000:3.0:1787360108.203804:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1121de3d-8714-4863-bc5d-127112ba378a/ffff998a3784b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787360108.203820:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787360108.203900:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787360108.203926:0:8447:0:(import.c:65:import_set_state_nolock()) ffff998a3784d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360108.203986:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2398:x1874182575012224:12345-192.168.206.11@tcp:8:lhsmtool_posix.0 Request processed in 251us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.203993:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1787360108.214461:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360108.214493:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012352 00000100:00100000:1.0:1787360108.214502:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012352 00000100:00100000:1.0:1787360108.214563:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1787360108.214573:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:0:x1874182575012352:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787360108.214710:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787360108.220382:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1787360108.220398:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000100:00100000:3.0:1787360108.237447:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:0:x1874182575012352:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 22863us (22983us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787360108.237459:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1787360108.252139:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360108.252192:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012608 00000100:00100000:1.0:1787360108.252201:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012608 00000100:00100000:1.0:1787360108.252272:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1787360108.252282:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+17:11295:x1874182575012608:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787360108.252479:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:11295:x1874182575012608:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 198us (351us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787360108.252487:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000040:00080000:3.0:1787360108.257916:0:14220:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787360108.257925:0:14220:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360108.257949:0:14220:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787360108.257954:0:14220:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360108.260312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.260428:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012864 00000100:00100000:2.0:1787360108.260438:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012864 00000100:00100000:2.0:1787360108.260489:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:2.0:1787360108.260499:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:11295:x1874182575012864:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787360108.260612:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:11295:x1874182575012864:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.260620:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:2.0:1787360108.272187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.272277:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575012992 00000100:00100000:3.0:1787360108.272287:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575012992 00000100:00100000:3.0:1787360108.272337:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:3.0:1787360108.272347:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+18:11295:x1874182575012992:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.272377:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.272397:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0d3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272459:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272473:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272484:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360108.272538:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360108.272555:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272580:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0d3 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272595:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0d3 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.272603:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:3.0:1787360108.272606:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787360108.272609:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8800, rc 0) 00000100:00100000:3.0:1787360108.272678:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+19:11295:x1874182575012992:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 332us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.272686:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:3.0:1787360108.281093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360108.282680:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013120 00000100:00100000:1.0:1787360108.282692:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013120 00000100:00100000:1.0:1787360108.282782:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1787360108.282791:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182575013120:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360108.282807:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360108.282825:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0da expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360108.282847:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f36c, blocks: 0x0 00010000:00010000:1.0:1787360108.282883:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1787360108.282887:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360108.282897:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.282915:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.282926:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70a00, rc 0) 00000100:00100000:1.0:1787360108.282986:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575013120:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 195us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360108.282992:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787360108.297560:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.297635:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013376 00000100:00100000:3.0:1787360108.297645:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013376 00000100:00100000:3.0:1787360108.297701:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1787360108.297711:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:11295:x1874182575013376:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360108.297806:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:11295:x1874182575013376:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.297815:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:0.0:1787360108.312972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360108.313117:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013504 00000100:00100000:1.0:1787360108.313127:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013504 00000100:00100000:1.0:1787360108.313177:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:1.0:1787360108.313186:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:11295:x1874182575013504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360108.313201:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360108.313218:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0e1 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.313276:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.313285:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360108.313289:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360108.313294:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.313334:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.313347:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 7 pid: 8447 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.313361:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596068736:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360108.313446:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360108.318262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.318567:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013632 00000100:00100000:3.0:1787360108.318575:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013632 00010000:00010000:3.0:1787360108.318610:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 8 pid: 8447 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.318655:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1787360108.318665:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2402:x1874182575013632:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360108.318679:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360108.318700:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 8 pid: 8447 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.319051:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 8 pid: 8447 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.319079:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360108.319093:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360108.319101:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.319112:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.319149:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.319162:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6516:1874182596068864:192.168.206.11@tcp:105: 00000100:00100000:3.0:1787360108.319251:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a012edd80 going to sleep for 11 seconds 00010000:00010000:1.0:1787360108.326721:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee7205ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0da expref: 8 pid: 8447 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.326742:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596068736:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360108.326771:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.326785:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:1.0:1787360108.326843:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:11295:x1874182575013504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 13657us (13876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360108.326851:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:1.0:1787360108.328798:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6516:1874182596068864:192.168.206.11@tcp:105: 00010000:00010000:1.0:1787360108.328818:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360108.328853:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182575013632:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 10188us (10598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360108.328885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1787360108.332136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.333065:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013760 00000100:00100000:3.0:1787360108.333075:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013760 00002000:00100000:3.0:1787360108.333120:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff998a37846d80 x1874182575013760/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:299/0 lens 504/0 e 0 to 0 dl 1787360119 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360108.333131:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998a37846d80 with x1874182575013760 ext(0->8) 00002000:00010000:3.0:1787360108.333136:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998a37846d80 00000100:00100000:3.0:1787360108.333173:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787360108.333183:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575013760:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787360108.334136:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575013760:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 949us (2003us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787360108.334145:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00002000:00100000:3.0:1787360108.334153:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff998a37846d80 x1874182575013760/t4294967303(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:299/0 lens 504/448 e 0 to 0 dl 1787360119 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360108.334174:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998a37846d80 with x1874182575013760 ext(0->8) 00002000:00010000:3.0:1787360108.334178:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998a37846d80 00000100:00100000:0.0:1787360108.340256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.340396:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575013888 00000100:00100000:3.0:1787360108.340406:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575013888 00000100:00100000:3.0:1787360108.340459:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:3.0:1787360108.340470:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+19:11295:x1874182575013888:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787360108.348799:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1787360108.348816:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787360108.348838:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1787360108.348890:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348903:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348911:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348918:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.348923:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348931:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348948:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:3.0:1787360108.348951:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360108.348956:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.348962:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee7205ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787360108.348994:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1787360108.349003:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787360108.349174:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575013888:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 8699us (8919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.349184:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:0.0:1787360108.349329:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360108.349344:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596068992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787360108.349462:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360108.349504:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596068992 00000100:00100000:0.0:1787360108.349785:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596068992 00000100:00100000:0.0:1787360108.349838:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787360108.349848:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596068992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787360108.349966:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787360108.349970:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787360108 00002000:00010000:0.0:1787360108.349972:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787360108.349974:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787360108 -> 1787360108 00002000:00010000:0.0:1787360108.349976:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787360108.350013:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3661:x1874182596068992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (551us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787360108.350021:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787360108.350037:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787360108.350067:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998a37845500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787360108.350072:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596068992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787360108.355124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.355251:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014016 00000100:00100000:3.0:1787360108.355259:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014016 00000100:00100000:3.0:1787360108.355342:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:3.0:1787360108.355361:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575014016:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787360108.356660:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787360108.356672:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787360108.356813:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575014016:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 1459us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.356823:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:1.0:1787360108.365049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.365126:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014272 00000100:00100000:2.0:1787360108.365135:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014272 00000100:00100000:2.0:1787360108.365187:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:2.0:1787360108.365197:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575014272:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.365267:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360108.365293:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee7205c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0d3 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.365310:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:2.0:1787360108.365315:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360108.365341:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.365476:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.365489:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360108.365612:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f37a5482 reply state 000000007c6fce1b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.365624:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.365644:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:2.0:1787360108.365647:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360108.365649:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360108.365747:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+15:11295:x1874182575014272:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 550us (706us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1787360108.365755:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:2.0:1787360108.368064:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360108.368152:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014400 00000100:00100000:1.0:1787360108.368160:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014400 00000100:00100000:1.0:1787360108.368213:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:1.0:1787360108.368260:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575014400:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787360108.368425:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787360108.368429:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787360108 -> 1787360106 00002000:00010000:1.0:1787360108.368431:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787360105 00002000:00010000:1.0:1787360108.368434:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787360108 -> 1787360106 00002000:00010000:1.0:1787360108.368436:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787360108.368486:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575014400:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 264us (429us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787360108.368495:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:1.0:1787360108.370953:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.371034:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014656 00000100:00100000:2.0:1787360108.371043:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014656 00000100:00100000:2.0:1787360108.371100:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:2.0:1787360108.371112:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:11295:x1874182575014656:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.371174:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.371192:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.371202:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.371282:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.371297:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 15 pid: 6532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.371311:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596069120:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360108.371403:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360108.374774:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596069120:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360108.374804:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.383735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.383806:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014784 00000100:00100000:0.0:1787360108.383814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014784 00010000:00010000:0.0:1787360108.383870:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 16 pid: 6532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.383900:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:0.0:1787360108.383909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+16:2400:x1874182575014784:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360108.383922:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.383928:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 16 pid: 6532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.383941:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 16 pid: 6532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.383962:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee7205a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0c5 expref: 16 pid: 6532 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.383976:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:0.0:1787360108.383980:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.383989:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.383997:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.384029:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360108.384089:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+15:2400:x1874182575014784:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.384097:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00010000:00010000:1.0:1787360108.389150:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389168:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389208:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389255:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389263:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389269:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360108.389273:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389281:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389298:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:1.0:1787360108.389302:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787360108.389306:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.389312:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7205e3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.389410:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575014656:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 18295us (18460us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787360108.389420:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:1.0:1787360108.406458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.409731:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575014912 00000100:00100000:2.0:1787360108.409748:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575014912 00000100:00100000:2.0:1787360108.409813:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:2.0:1787360108.409825:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575014912:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.409883:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.409904:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.409913:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.409918:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360108.409924:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.409958:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.409973:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 7 pid: 8448 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.409987:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596069248:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360108.410067:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989034789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360108.416593:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.416717:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596069248:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360108.416743:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.416770:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015040 00000100:00100000:0.0:1787360108.416775:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015040 00010000:00010000:0.0:1787360108.416805:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.416849:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:0.0:1787360108.416859:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575015040:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360108.416882:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.416902:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.416914:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.416937:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee7205d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e1 expref: 8 pid: 8448 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.416951:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360108.416955:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360108.416968:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.416977:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417000:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360108.417043:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575015040:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.417050:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00010000:00010000:0.0:1787360108.417070:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417078:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417096:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417105:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417112:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417119:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360108.417123:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417139:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417151:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.417160:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b02223e0/0x359a4e2aee7205ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.417203:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182575014912:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 7381us (10752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.417211:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1787360108.420281:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.420601:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015296 00000100:00100000:3.0:1787360108.420610:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015296 00000100:00100000:3.0:1787360108.420662:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 93 00000100:00100000:3.0:1787360108.420672:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:11295:x1874182575015296:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.420740:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.420756:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 14 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.420766:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.420796:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 14 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.420817:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 14 pid: 9449 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.420832:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069376:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360108.420919:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a012edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360108.425811:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.425840:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015424 00000100:00100000:0.0:1787360108.425848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015424 00010000:00010000:0.0:1787360108.425893:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 15 pid: 9449 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.425926:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:0.0:1787360108.425936:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+15:2399:x1874182575015424:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360108.425948:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.425955:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 15 pid: 9449 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.425978:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 15 pid: 9449 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.425998:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360108.426004:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.426013:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.426020:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.426038:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360108.426082:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+15:2399:x1874182575015424:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 148us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.426089:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00010000:00010000:1.0:1787360108.426405:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef06a expref: 14 pid: 9449 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.426431:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069376:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360108.426449:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426458:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426464:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426618:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426631:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 14 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426639:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426664:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 14 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.426677:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 14 pid: 11098 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.426690:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069504:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360108.426740:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787360108.437935:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069504:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360108.437963:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.439117:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360108.439204:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015552 00000100:00100000:2.0:1787360108.439212:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015552 00010000:00010000:2.0:1787360108.439291:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 15 pid: 11098 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.439327:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360108.439336:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+15:2400:x1874182575015552:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360108.439349:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360108.439366:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 15 pid: 11098 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439378:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 15 pid: 11098 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439398:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee7205b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0cc expref: 15 pid: 11098 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439413:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:2.0:1787360108.439418:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439427:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439435:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.439455:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360108.439496:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:2400:x1874182575015552:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 161us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.439503:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00010000:00010000:0.0:1787360108.439621:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.439629:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360108.439733:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1787360108.439835:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1787360108.439881:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1787360108.439960:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904186d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874182596069632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787360108.440004:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360108.440042:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360108.441203:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596069632 00000100:00100000:2.0:1787360108.441214:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596069632 00000100:00100000:2.0:1787360108.441285:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787360108.441295:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9449:x1874182596069632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787360108.441409:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9449:x1874182596069632:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.441417:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787360108.441628:0:9449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787360108.441634:0:9449:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998a37845500, transno 4294967304 00000100:00100000:3.0:1787360108.441654:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904186d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874182596069632:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787360108.441782:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787360108.441870:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874182596069760:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787360108.441904:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360108.441931:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a014ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360108.442114:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596069760 00000100:00100000:2.0:1787360108.442119:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596069760 00000100:00100000:2.0:1787360108.442157:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787360108.442164:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9449:x1874182596069760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787360108.442299:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9449:x1874182596069760:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (394us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787360108.442306:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787360108.442640:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9449:1874182596069760:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787360108.442677:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442687:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442695:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442719:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.442724:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442732:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442748:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:3.0:1787360108.442751:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360108.442755:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442762:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7205f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442791:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442798:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442804:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442810:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360108.442813:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442819:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442849:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:3.0:1787360108.442852:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360108.442855:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442870:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720526 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442893:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442906:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442916:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442941:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.442954:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 17 pid: 6531 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.442965:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069888:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360108.443028:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a014ebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360108.465068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360108.465120:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596069888:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360108.465145:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.468458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015680 00000100:00100000:0.0:1787360108.468483:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015680 00010000:00010000:0.0:1787360108.468562:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 18 pid: 6531 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.468632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:0.0:1787360108.468655:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+18:2399:x1874182575015680:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360108.468682:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.468690:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 18 pid: 6531 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468718:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 18 pid: 6531 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468755:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720542 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0b0 expref: 18 pid: 6531 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468785:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360108.468805:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468817:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468836:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.468885:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360108.468937:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+17:2399:x1874182575015680:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 284us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.468952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00010000:00010000:0.0:1787360108.469069:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469077:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469087:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469094:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469100:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469106:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360108.469110:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469118:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469128:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360108.469130:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360108.469134:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469140:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee7205ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469150:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469162:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469168:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469173:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360108.469176:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469182:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469190:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719600) 00010000:00010000:0.0:1787360108.469193:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360108.469195:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.469201:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee7205f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.469355:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+16:11295:x1874182575015296:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 48683us (49082us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787360108.469364:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 93 00000020:00080000:0.0:1787360108.469367:0:9449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787360108.469447:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360108.469451:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360108.469466:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787360108.469474:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360108.472829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360108.473393:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575015936 00000100:00100000:0.0:1787360108.473432:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575015936 00000100:00100000:0.0:1787360108.473536:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1787360108.473563:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+16:11295:x1874182575015936:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787360108.473918:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787360108.473947:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1787360108.473978:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.473993:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474004:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474012:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474018:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474024:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474043:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787360108.474120:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:11295:x1874182575015936:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 574us (1306us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787360108.474128:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000020:00080000:0.0:1787360108.474133:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787360108.474156:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360108.474162:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474180:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeec00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360108.474184:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474191:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474203:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:0.0:1787360108.474206:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787360108.474211:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474217:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720606 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.474255:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360108.474257:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360108.474259:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360108.665743:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360108.793543:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596070016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360108.793610:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360108.793823:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070016 00000100:00100000:0.0:1787360108.793831:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070016 00000100:00100000:0.0:1787360108.793885:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787360108.793894:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596070016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360108.793924:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360108.793979:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596070016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.793986:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787360108.794066:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904185500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596070016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360109.423400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360109.423449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360109.423459:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016064 00000100:00100000:1.0:1787360109.423472:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016064 00000100:00100000:2.0:1787360109.423544:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016192 00000100:00100000:2.0:1787360109.423548:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016192 00000100:00100000:1.0:1787360109.423558:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 383 00000100:00100000:1.0:1787360109.423568:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182575016064:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360109.423588:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 289 00000100:00100000:2.0:1787360109.423594:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:2402:x1874182575016192:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360109.423808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182575016064:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 239us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360109.423816:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 383 00000100:00100000:1.0:1787360109.430728:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:2402:x1874182575016192:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 7116us (7260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360109.430747:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 289 00000100:00100000:1.0:1787360109.430849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360109.431486:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360109.431748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360109.431777:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360109.432004:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016448 00000100:00100000:0.0:1787360109.432017:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016448 00000100:00100000:0.0:1787360109.432072:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016576 00000100:00100000:0.0:1787360109.432076:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016576 00000100:00100000:0.0:1787360109.432113:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:0.0:1787360109.432125:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182575016448:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360109.432671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360109.432709:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016320 00000100:00100000:1.0:1787360109.432715:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016320 00000100:00100000:1.0:1787360109.432755:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016704 00000100:00100000:1.0:1787360109.432759:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016704 00000100:00100000:1.0:1787360109.432780:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575016832 00000100:00100000:1.0:1787360109.432783:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575016832 00000100:00100000:1.0:1787360109.432801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00100000:1.0:1787360109.432810:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575016320:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360109.433327:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182575016448:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1200us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.433338:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:1.0:1787360109.433476:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575016320:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 666us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360109.433484:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 290 00000100:00100000:0.0:1787360109.433653:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:0.0:1787360109.433664:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575016576:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360109.433700:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575016576:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 38us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.433706:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:0.0:1787360109.434338:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:0.0:1787360109.434361:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575016704:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360109.434406:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575016704:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 59us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.434413:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 291 00000100:00100000:0.0:1787360109.434430:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00100000:0.0:1787360109.434437:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575016832:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360109.434462:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575016832:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.434468:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 292 00000100:00080000:0.0:1787360109.435308:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360109.435317:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360109.435321:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787360109.690297:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360109.817435:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360109.817528:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.817615:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070144 00000100:00100000:3.0:1787360109.817626:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070144 00000100:00100000:3.0:1787360109.817681:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787360109.817692:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596070144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360109.817728:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360109.817776:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596070144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360109.817783:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787360109.817841:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596070144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360109.820021:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360109.820049:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596070272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360109.820130:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.820193:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070272 00000100:00100000:3.0:1787360109.820215:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070272 00000100:00100000:3.0:1787360109.820297:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787360109.820308:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596070272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360109.820333:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360109.820554:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596070272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360109.820563:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1787360109.820590:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360109.820632:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596070272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360109.824145:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596070400:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.824278:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360109.824391:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070400 00000100:00100000:0.0:1787360109.824401:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070400 00000100:00100000:0.0:1787360109.824462:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787360109.824474:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596070400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360109.825307:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596070528:0@lo:400:kworker.0 00000100:00100000:2.0:1787360109.825359:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360109.825662:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070528 00000100:00100000:2.0:1787360109.825670:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070528 00000100:00100000:2.0:1787360109.825724:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787360109.825734:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596070528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360109.825810:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596070528:12345-0@lo:400:kworker.0 Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360109.825818:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787360109.825899:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596070528:0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.826827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596070400:12345-0@lo:400:kworker.0 Request processed in 2349us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.826840:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787360109.827004:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596070784:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.827050:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360109.827078:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596071296:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.827102:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360109.827122:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787360109.827128:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596070656:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.827151:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360109.827168:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596071168:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.827189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360109.827220:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596071680:0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.827261:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070784 00000100:00100000:1.0:1787360109.827265:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360109.827269:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070784 00000100:00100000:0.0:1787360109.827303:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071168 00000100:00100000:1.0:1787360109.827306:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071680 00000100:00100000:0.0:1787360109.827306:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071168 00000100:00100000:1.0:1787360109.827309:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071680 00000100:00100000:0.0:1787360109.827336:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787360109.827345:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596070784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360109.827393:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787360109.827402:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596071168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.827406:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596070784:12345-0@lo:400:kworker.0 Request processed in 62us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.827412:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787360109.827438:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596071168:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360109.827445:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787360109.829084:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596070400:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.829132:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596070912:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.829200:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.829389:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596071424:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.829717:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.829761:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787360109.829771:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596071040:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.829804:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.829832:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596071552:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.829876:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.829932:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071296 00000100:00100000:3.0:1787360109.829951:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071296 00000100:00100000:0.0:1787360109.832580:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070656 00000100:00100000:0.0:1787360109.832598:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070656 00000100:00100000:0.0:1787360109.832676:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596070912 00000100:00100000:0.0:1787360109.832680:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596070912 00000100:00100000:0.0:1787360109.832704:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787360109.832716:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596070656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.832830:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596070656:12345-0@lo:400:kworker.0 Request processed in 115us (5676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.832838:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787360109.832888:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787360109.832895:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596070912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.832939:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596070912:12345-0@lo:400:kworker.0 Request processed in 44us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.832946:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787360109.834072:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071040 00000100:00100000:1.0:1787360109.834087:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071040 00000100:00100000:1.0:1787360109.834116:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071552 00000100:00100000:1.0:1787360109.834119:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071552 00000100:00100000:1.0:1787360109.834144:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787360109.834154:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596071680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.834248:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596071680:12345-0@lo:400:kworker.0 Request processed in 96us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360109.834256:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787360109.834278:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787360109.834284:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596071040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360109.834309:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787360109.834316:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596071040:12345-0@lo:400:kworker.0 Request processed in 33us (4513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.834318:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596071552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.834340:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787360109.834367:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596071424 00000100:00100000:1.0:1787360109.834371:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596071424 00000100:00100000:1.0:1787360109.834402:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787360109.834409:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596071424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.834444:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596071424:12345-0@lo:400:kworker.0 Request processed in 35us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360109.834450:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787360109.834850:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596071552:12345-0@lo:400:kworker.0 Request processed in 36us (4477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360109.834870:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787360109.836099:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787360109.836118:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596071296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.836208:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596071296:12345-0@lo:400:kworker.0 Request processed in 97us (9104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360109.836216:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1787360109.836266:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360109.836273:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360109.836277:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360109.836330:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596071040:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.836348:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596071552:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.836387:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596070912:0@lo:400:kworker.0 00000100:00100000:3.0:1787360109.836403:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596071424:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.840498:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596070656:0@lo:400:kworker.0 00010000:00080000:1.0:1787360109.840526:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989042b2d80 x1874182596071168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360109.840537:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596071168:0@lo:400:kworker.0 00010000:00080000:1.0:1787360109.840551:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904192d80 x1874182596071680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360109.840560:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596071680:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.840574:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596070784:0@lo:400:kworker.0 00000100:00100000:1.0:1787360109.840587:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596071296:0@lo:400:kworker.0 00000040:00080000:0.0:1787360110.226883:0:14271:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360110.226895:0:14271:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360110.226923:0:14271:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787360110.226933:0:14271:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360110.344949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.345146:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575017088 00000100:00100000:1.0:1787360110.345160:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575017088 00000100:00100000:1.0:1787360110.345908:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:1.0:1787360110.345923:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+18:11313:x1874182575017088:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360110.345950:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.345978:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72060d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0e8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.346125:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee720614 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.346143:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee720614 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.346160:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee720614 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360110.346175:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787360110.346331:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee72060d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e8 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.346350:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee720614 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e8 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.346361:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360110.346364:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787360110.346368:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71000, rc 0) 00000100:00100000:1.0:1787360110.346455:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+20:11313:x1874182575017088:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 535us (1519us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787360110.346465:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00080000:2.0:1787360110.346710:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360110.350522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.350935:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575017216 00000100:00100000:2.0:1787360110.350949:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575017216 00000100:00100000:2.0:1787360110.351027:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:2.0:1787360110.351039:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:11313:x1874182575017216:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:2.0:1787360110.351143:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351161:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351173:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351190:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351196:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351257:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351357:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351364:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351371:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360110.351425:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351440:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351447:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351454:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351461:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.351465:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351473:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351487:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360110.351496:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.351502:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351508:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720622 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351525:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351531:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351537:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351543:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.351546:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351552:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351559:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a227ad100) 00010000:00010000:2.0:1787360110.351561:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.351564:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351570:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351585:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351597:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351602:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351607:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.351611:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351617:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351624:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360110.351626:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.351629:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.351634:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720630 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.351724:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:11313:x1874182575017216:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 687us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360110.351732:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:1.0:1787360110.387366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360110.387471:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575017472 00000100:00100000:3.0:1787360110.387485:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575017472 00000100:00100000:3.0:1787360110.387565:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:3.0:1787360110.387579:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+20:11316:x1874182575017472:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360110.387607:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360110.387637:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0ef expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387742:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387760:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387772:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387789:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387797:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387804:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387987:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.387996:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388004:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360110.388014:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787360110.388108:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388116:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388123:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388129:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360110.388135:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388143:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388156:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:3.0:1787360110.388159:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360110.388165:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388184:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee72063e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388200:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388206:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388212:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388218:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360110.388221:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388267:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388276:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998902719300) 00010000:00010000:3.0:1787360110.388278:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360110.388281:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388287:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388334:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 23 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388349:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 22 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.388364:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360110.388366:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360110.388369:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9400, rc 0) 00000100:00100000:3.0:1787360110.388626:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+22:11316:x1874182575017472:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1049us (1275us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787360110.388636:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:0.0:1787360110.403162:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.403395:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575017600 00000100:00100000:1.0:1787360110.403408:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575017600 00000100:00100000:1.0:1787360110.403479:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360110.403493:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:11316:x1874182575017600:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1787360110.403614:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403636:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403714:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403760:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403768:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403776:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403783:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.403788:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403797:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403810:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.403813:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360110.403819:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.403826:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee72065a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360110.403987:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:11316:x1874182575017600:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 495us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360110.403997:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360110.410428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.410564:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575017856 00000100:00100000:2.0:1787360110.410577:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575017856 00000100:00100000:2.0:1787360110.410653:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360110.410668:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20567450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:11316:x1874182575017856:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360110.411060:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20567450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+23:11316:x1874182575017856:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 392us (645us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787360110.411077:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1787360110.459072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360110.459128:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018112 00000100:00100000:0.0:1787360110.459141:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018112 00000100:00100000:0.0:1787360110.459205:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:0.0:1787360110.459219:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+23:10836:x1874182575018112:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360110.459366:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360110.459461:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720661 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0f6 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.459607:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.460939:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.460958:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.461018:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.461036:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 24 pid: 9449 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360110.461055:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904184000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596071808:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360110.461194:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360110.469487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360110.470030:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904184000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596071808:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360110.470063:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360110.470335:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018240 00000100:00100000:3.0:1787360110.470345:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018240 00010000:00010000:3.0:1787360110.470400:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 25 pid: 9449 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360110.470445:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:3.0:1787360110.470457:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+25:2399:x1874182575018240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360110.470477:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360110.470485:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 25 pid: 9449 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470510:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 25 pid: 9449 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470539:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee72064c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0ef expref: 25 pid: 9449 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470565:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360110.470578:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470590:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470597:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.470623:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360110.470687:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+24:2399:x1874182575018240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 232us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360110.470696:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00010000:00010000:0.0:1787360110.472681:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.472702:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360110.472736:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787360110.472918:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720661 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 25 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.472952:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 24 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.472962:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:0.0:1787360110.472965:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360110.472969:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:0.0:1787360110.473038:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+24:10836:x1874182575018112:12345-192.168.206.11@tcp:101:bash.0 Request processed in 13822us (13982us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1787360110.473048:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:2.0:1787360110.477872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360110.477951:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018368 00000100:00100000:3.0:1787360110.477965:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018368 00000100:00100000:3.0:1787360110.478442:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:3.0:1787360110.478455:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+24:10836:x1874182575018368:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360110.478486:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360110.478511:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720676 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef0fd expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478554:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee72067d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478571:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee72067d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478585:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee72067d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478729:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0fd expref: 26 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478757:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee72067d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0fd expref: 25 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.478767:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360110.478771:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787360110.478774:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9200, rc 0) 00000100:00100000:3.0:1787360110.478867:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+25:10836:x1874182575018368:12345-192.168.206.11@tcp:101:bash.0 Request processed in 414us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360110.478876:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:0.0:1787360110.484633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.484714:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018624 00000100:00100000:1.0:1787360110.484727:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018624 00000100:00100000:1.0:1787360110.484807:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:1.0:1787360110.484819:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:10836:x1874182575018624:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:1.0:1787360110.485135:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.485155:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.485166:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360110.485648:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1787360110.485688:0:6532:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058b9c4d8 reply state 00000000751f810a transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.485706:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.485714:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.485717:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360110.485722:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787360110.485774:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1787360110.486431:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:10836:x1874182575018624:12345-192.168.206.11@tcp:36:bash.0 Request processed in 1608us (1808us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787360110.486460:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00000020:00080000:1.0:1787360110.486466:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787360110.503634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360110.503740:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018752 00000100:00100000:0.0:1787360110.503755:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018752 00000100:00100000:1.0:1787360110.503886:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:1.0:1787360110.503901:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+29:10836:x1874182575018752:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360110.503936:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.503971:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72068b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef104 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.504054:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72068b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef104 expref: 30 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.504072:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72068b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef104 expref: 30 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.504098:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.504101:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360110.504107:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:1.0:1787360110.504186:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+30:10836:x1874182575018752:12345-192.168.206.11@tcp:101:bash.0 Request processed in 289us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360110.504194:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:3.0:1787360110.508471:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.508600:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575018880 00000100:00100000:1.0:1787360110.508613:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575018880 00000100:00100000:1.0:1787360110.508713:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1787360110.508725:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:10836:x1874182575018880:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360110.508748:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.508775:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef10b expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360110.508823:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a88f36a, atime: 0x6a88f369, ctime: 0x6a88f36a, blocks: 0x8 00010000:00010000:1.0:1787360110.508863:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1787360110.508868:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360110.508878:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.508900:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.508915:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71800, rc 0) 00000100:00100000:1.0:1787360110.508991:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:10836:x1874182575018880:12345-192.168.206.11@tcp:101:bash.0 Request processed in 268us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360110.509000:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00080000:2.0:1787360110.509570:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360110.511320:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.511424:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019008 00000100:00100000:1.0:1787360110.511439:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019008 00002000:00010000:1.0:1787360110.511504:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787360110.511518:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998903b84700 with x1874182575019008 ext(0->18446744073709551615) 00002000:00010000:1.0:1787360110.511535:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998903b84700. 00000100:00100000:1.0:1787360110.511574:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:1.0:1787360110.511587:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575019008:12345-192.168.206.11@tcp:10:bash.0 00002000:00010000:1.0:1787360110.511990:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787360110.511994:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787360106 -> 1787360110 00002000:00010000:1.0:1787360110.511998:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787360105 -> 1787360105 00002000:00010000:1.0:1787360110.512000:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787360106 -> 1787360110 00002000:00010000:1.0:1787360110.512008:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787360110.512092:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575019008:12345-192.168.206.11@tcp:10:bash.0 Request processed in 506us (784us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787360110.512101:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00002000:00010000:1.0:1787360110.512107:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1787360110.512110:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998903b84700 with x1874182575019008 ext(0->18446744073709551615) 00002000:00010000:1.0:1787360110.512115:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998903b84700. 00000100:00100000:3.0:1787360110.585989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.586185:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019136 00000100:00100000:2.0:1787360110.586198:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019136 00000100:00100000:2.0:1787360110.586309:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:2.0:1787360110.586321:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+30:11331:x1874182575019136:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:2.0:1787360110.586428:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586450:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586465:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586485:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586493:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586500:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586588:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586620:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586627:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360110.586683:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586696:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586703:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586711:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586717:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.586722:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586730:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586744:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360110.586748:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.586753:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586760:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720699 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586784:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586791:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586797:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586803:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.586807:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586813:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586820:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a227ada00) 00010000:00010000:2.0:1787360110.586822:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.586825:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586832:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee7206a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586848:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586870:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586877:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586889:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360110.586892:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586899:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586907:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:2.0:1787360110.586910:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360110.586913:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.586919:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.587770:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+30:11331:x1874182575019136:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 1441us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360110.587784:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:0.0:1787360110.645093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.645265:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019392 00000100:00100000:1.0:1787360110.645280:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019392 00000100:00100000:1.0:1787360110.645348:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:1.0:1787360110.645360:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+30:11334:x1874182575019392:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360110.645387:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.645413:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef112 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645533:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645551:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645565:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645582:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645589:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645619:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645775:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee7206c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645787:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee7206c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645795:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee7206c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360110.645819:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787360110.645924:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645933:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645942:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645950:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.645955:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645965:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.645979:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360110.645983:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.645995:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646002:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646019:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646026:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646033:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646039:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.646042:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646048:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646056:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360110.646058:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.646061:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646066:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646116:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef112 expref: 33 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646144:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee7206c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef112 expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.646152:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.646155:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787360110.646158:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70e00, rc 0) 00000100:00100000:1.0:1787360110.646311:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+32:11334:x1874182575019392:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 952us (1234us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787360110.646321:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:1.0:1787360110.652356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.652663:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019520 00000100:00100000:2.0:1787360110.652676:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019520 00000100:00100000:2.0:1787360110.652748:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:2.0:1787360110.652760:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:11334:x1874182575019520:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:2.0:1787360110.652841:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.652871:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 32 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.652883:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.652939:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 32 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.653124:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 32 pid: 11098 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.653142:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596071936:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360110.653336:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360110.669151:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596071936:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360110.669194:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360110.670168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.670912:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019776 00000100:00100000:2.0:1787360110.670926:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019776 00000100:00100000:2.0:1787360110.671012:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360110.671023:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+33:6171:x1874182575019776:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787360110.671535:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+34:6171:x1874182575019776:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 511us (1372us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787360110.671544:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360110.675896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360110.683300:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575019904 00000100:00100000:0.0:1787360110.683325:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575019904 00010000:00010000:2.0:1787360110.683559:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 34 pid: 11098 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.683616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:2.0:1787360110.683629:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+34:2399:x1874182575019904:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360110.683648:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360110.683657:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 34 pid: 11098 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683695:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 34 pid: 11098 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683725:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720668 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0f6 expref: 34 pid: 11098 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683747:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:2.0:1787360110.683754:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683765:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683773:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.683806:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360110.683901:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.683906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+33:2399:x1874182575019904:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 277us (8023us total) trans 0 rc 0/0 00010000:00010000:1.0:1787360110.683919:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.683923:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00010000:00010000:1.0:1787360110.684045:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684054:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684061:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684076:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.684081:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684089:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684101:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.684104:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360110.684107:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.684113:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee7206d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360110.684160:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:11334:x1874182575019520:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 31402us (31817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360110.684169:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:0.0:1787360110.689562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360110.689714:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575020160 00000100:00100000:3.0:1787360110.689730:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575020160 00000100:00100000:3.0:1787360110.689804:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360110.689818:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:11334:x1874182575020160:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360110.690134:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+33:11334:x1874182575020160:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 318us (597us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787360110.690143:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:0.0:1787360110.713760:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360110.794605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.795651:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575020416 00000100:00100000:1.0:1787360110.795669:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575020416 00000100:00100000:1.0:1787360110.795759:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:1.0:1787360110.795771:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+33:11345:x1874182575020416:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1787360110.795817:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.795845:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef119 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.795954:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796013:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796030:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796048:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796056:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796063:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796206:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7206ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796217:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7206ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796269:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7206ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360110.796281:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787360110.796375:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796384:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796391:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796404:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.796410:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796419:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796433:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360110.796436:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.796442:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796448:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7206df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796465:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796471:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796477:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796483:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.796486:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.796492:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.798217:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360110.798222:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.798251:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.799487:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee7206e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.800692:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef119 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.800718:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7206ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef119 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.800728:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.800731:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360110.800735:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360110.802716:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+35:11345:x1874182575020416:12345-192.168.206.11@tcp:101:cat.0 Request processed in 6930us (8110us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787360110.802733:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:0.0:1787360110.808613:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360110.808709:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575020672 00000100:00100000:3.0:1787360110.808723:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575020672 00000100:00100000:2.0:1787360110.808968:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360110.808984:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:11345:x1874182575020672:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:2.0:1787360110.809674:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+36:11345:x1874182575020672:12345-192.168.206.11@tcp:35:cat.0 Request processed in 690us (1070us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787360110.809686:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:0.0:1787360110.840777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.841038:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575020928 00000100:00100000:1.0:1787360110.841051:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575020928 00000100:00100000:1.0:1787360110.841126:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:1.0:1787360110.841138:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+36:11346:x1874182575020928:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:1.0:1787360110.841214:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787360110.841301:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72068b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef104 expref: 36 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841349:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7206ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef119 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841362:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee7206c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef112 expref: 34 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841374:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee72067d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0fd expref: 33 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841388:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.841394:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360110.841437:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841454:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841465:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841482:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841488:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841494:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.841598:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596072064:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787360110.841677:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.841680:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360110.841688:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.841695:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360110.842053:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596072064 00000100:00100000:3.0:1787360110.842062:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596072064 00000100:00100000:3.0:1787360110.842120:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787360110.842128:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596072064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360110.842157:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000040:00080000:1.0:1787360110.842280:0:11098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787360110.842293:0:11098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389089066340ns, next at 390089063109ns, rc = 0 00010000:00010000:1.0:1787360110.842350:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842362:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842370:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842377:0:11098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842383:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842389:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842457:0:11098:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360110.842494:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842507:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842514:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842520:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.842525:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842533:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842544:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:1.0:1787360110.842547:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787360110.842552:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842565:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee720709 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842585:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842591:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842596:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842601:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.842610:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842616:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842624:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360110.842627:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.842630:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842636:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7206fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360110.842647:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6204de0 reply state 000000008b825976 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842658:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.842664:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360110.842667:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360110.842669:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360110.842753:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+34:11346:x1874182575020928:12345-192.168.206.11@tcp:36:rm.0 Request processed in 1615us (1990us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787360110.842838:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00010000:00010000:0.0:1787360110.844121:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360110.844136:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.844149:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360110.844154:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.844186:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.844203:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:0.0:1787360110.844206:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787360110.844210:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.844215:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720710 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.845409:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360110.845416:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360110.845419:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360110.847516:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596072064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5366us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360110.847537:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787360110.849476:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596072064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360110.890941:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.891146:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021184 00000100:00100000:1.0:1787360110.891163:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021184 00000100:00100000:1.0:1787360110.891277:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:1.0:1787360110.891289:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+34:11352:x1874182575021184:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360110.891321:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.891363:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720717 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef120 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891497:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891515:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891528:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891540:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891549:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.891568:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360110.892065:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787360110.892327:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892338:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892346:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892385:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892412:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892421:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892427:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360110.892435:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892442:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892455:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360110.892459:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360110.892464:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892471:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72071e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360110.892487:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000284233d3 reply state 000000009cb2b4be transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892503:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892509:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360110.892511:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360110.892515:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787360110.892549:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720717 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892895:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 36 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.892903:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:1.0:1787360110.892905:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360110.892908:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360110.893056:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:11352:x1874182575021184:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1767us (2126us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787360110.893065:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:1.0:1787360110.897579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360110.897687:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021312 00000100:00100000:3.0:1787360110.897698:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021312 00000100:00100000:3.0:1787360110.897820:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1787360110.897833:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575021312:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360110.897864:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360110.897895:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef127 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360110.897936:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360110.897959:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1787360110.897964:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360110.897975:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.898008:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360110.898025:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8a00, rc 0) 00000100:00100000:3.0:1787360110.898099:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2401:x1874182575021312:12345-192.168.206.11@tcp:101:bash.0 Request processed in 268us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360110.898608:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1787360110.901480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360110.901665:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021440 00000100:00100000:1.0:1787360110.901677:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021440 00000100:00100000:1.0:1787360110.901754:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360110.901775:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:11352:x1874182575021440:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360110.901907:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360110.901935:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef12e expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.901975:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.901985:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360110.901990:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360110.901996:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 9 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.902060:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360110.902074:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360110.902089:0:8770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1874182596072192:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360110.902324:0:8770:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787360110.914314:0:8770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1874182596072192:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360110.914362:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 9 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360110.914389:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71600, rc 0) 00000100:00100000:0.0:1787360110.914525:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+9:11352:x1874182575021440:12345-192.168.206.11@tcp:101:bash.0 Request processed in 12752us (13057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360110.914535:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360110.914646:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.914876:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021568 00000100:00100000:2.0:1787360110.914885:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021568 00010000:00010000:2.0:1787360110.914937:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.914980:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:2.0:1787360110.914991:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575021568:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360110.915015:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360110.915041:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.915056:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.915082:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee72073a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef127 expref: 9 pid: 8448 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.915100:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360110.915115:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360110.915134:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.915146:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360110.915207:0:7474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360110.915259:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1874182596072320:192.168.206.11@tcp:105: 00000100:00100000:2.0:1787360110.915327:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360110.923565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360110.923628:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021824 00000100:00100000:2.0:1787360110.923640:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021824 00000100:00100000:2.0:1787360110.923700:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:2.0:1787360110.923712:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+37:11352:x1874182575021824:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1787360110.924323:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+38:11352:x1874182575021824:12345-192.168.206.11@tcp:35:bash.0 Request processed in 609us (770us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787360110.924334:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:3.0:1787360110.926942:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1874182596072320:192.168.206.11@tcp:105: 00010000:00010000:3.0:1787360110.926977:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360110.927098:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575021568:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 12108us (13005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360110.927118:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:2.0:1787360111.090525:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.090735:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575021952 00000100:00100000:1.0:1787360111.090749:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575021952 00000100:00100000:1.0:1787360111.091211:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 108 00000100:00100000:1.0:1787360111.091256:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+38:11368:x1874182575021952:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360111.091286:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.091313:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef135 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091430:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091446:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091460:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360111.091546:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787360111.091561:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360111.091586:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091620:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef135 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091644:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef135 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.091655:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360111.091659:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360111.091664:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70000, rc 0) 00000100:00100000:1.0:1787360111.091769:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+39:11368:x1874182575021952:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 537us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.091776:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 108 00000100:00100000:1.0:1787360111.098862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.102114:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022208 00000100:00100000:0.0:1787360111.102136:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022208 00000100:00100000:0.0:1787360111.102238:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 109 00000100:00100000:0.0:1787360111.102252:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+39:11368:x1874182575022208:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360111.102297:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360111.102325:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720756 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef13c expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.102521:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee72075d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.102538:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee72075d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.102551:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee72075d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360111.102565:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787360111.102772:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720756 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef13c expref: 42 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.102793:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee72075d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef13c expref: 41 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.102819:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:0.0:1787360111.102943:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360111.102947:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef400, rc 0) 00000100:00100000:0.0:1787360111.103050:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+41:11368:x1874182575022208:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 799us (4213us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787360111.103058:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 109 00000100:00100000:2.0:1787360111.110374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.110481:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022464 00000100:00100000:1.0:1787360111.110500:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022464 00000100:00100000:1.0:1787360111.110721:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 110 00000100:00100000:1.0:1787360111.110803:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+41:11368:x1874182575022464:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360111.110835:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.110871:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72076b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef143 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.111572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.111777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022592 00000100:00100000:0.0:1787360111.111787:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022592 00000100:00100000:0.0:1787360111.111923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360111.111948:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+43:2399:x1874182575022592:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360111.111966:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360111.112002:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee72075d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef13c expref: 43 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.112021:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:0.0:1787360111.112025:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360111.112097:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+42:2399:x1874182575022592:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 152us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.112105:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00010000:00010000:1.0:1787360111.112291:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.112328:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.112342:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360111.112359:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787360111.112502:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee72076b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef143 expref: 43 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.112523:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef143 expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.112533:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:1.0:1787360111.113114:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787360111.113122:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:1.0:1787360111.113335:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+42:11368:x1874182575022464:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 2533us (2968us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787360111.113345:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 110 00000100:00100000:2.0:1787360111.135122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.135318:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022720 00000100:00100000:0.0:1787360111.135331:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022720 00000100:00100000:0.0:1787360111.135422:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:0.0:1787360111.135436:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2402:x1874182575022720:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:0.0:1787360111.135498:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.135548:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.135559:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360111.135565:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360111.135570:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.135632:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.135667:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 8 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.135687:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596072448:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360111.135824:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c540 going to sleep for 11 seconds 00000100:00080000:2.0:1787360111.137100:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360111.142328:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596072448:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360111.142368:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.144562:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.144808:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022848 00000100:00100000:0.0:1787360111.144822:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022848 00002000:00100000:0.0:1787360111.144964:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff998903b86d80 x1874182575022848/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:302/0 lens 504/0 e 0 to 0 dl 1787360122 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360111.144979:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998903b86d80 with x1874182575022848 ext(0->8) 00010000:00010000:0.0:1787360111.145066:0:8454:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 9 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.145088:0:8454:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 9 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360111.145097:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff998903b86d80 00000100:00100000:0.0:1787360111.145190:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:0.0:1787360111.145202:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575022848:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:0.0:1787360111.148155:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+11:2400:x1874182575022848:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 2776us (3438us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787360111.148175:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00002000:00100000:0.0:1787360111.148193:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff998903b86d80 x1874182575022848/t4294967303(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:302/0 lens 504/448 e 0 to 0 dl 1787360122 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360111.148204:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998903b86d80 with x1874182575022848 ext(0->8) 00010000:00010000:0.0:1787360111.148217:0:8454:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.148265:0:8454:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360111.148429:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff998903b86d80 00000100:00100000:2.0:1787360111.151347:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360111.152629:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575022976 00000100:00100000:3.0:1787360111.152646:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575022976 00010000:00010000:3.0:1787360111.152701:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360111.152759:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:3.0:1787360111.152770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+11:2399:x1874182575022976:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360111.152787:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787360111.152808:0:6516:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787360111.152811:0:6516:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787360110 00002000:00010000:3.0:1787360111.152814:0:6516:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787360111 00002000:00010000:3.0:1787360111.152817:0:6516:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787360110 00002000:00010000:3.0:1787360111.152819:0:6516:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787360111.152826:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.152842:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.152879:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb1f7c2b/0x359a4e2aee720741 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef12e expref: 11 pid: 8770 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.152900:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360111.152905:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360111.152929:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.152941:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.152987:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360111.153059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+10:2399:x1874182575022976:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 290us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360111.153068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00010000:00010000:3.0:1787360111.153694:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153708:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153735:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153745:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153754:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153762:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360111.153767:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153786:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153803:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.153811:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfde3aed/0x359a4e2aee720780 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360111.153888:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+9:2402:x1874182575022720:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 18454us (18779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360111.153897:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000001:00080000:1.0:1787360111.160913:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787360111.160939:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787360111.164582:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360111.164867:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575023232 00000100:00100000:2.0:1787360111.164887:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575023232 00000100:00100000:2.0:1787360111.164957:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1787360111.164969:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20565c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+42:11368:x1874182575023232:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:2.0:1787360111.165553:0:6535:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef143 expref: 42 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360111.165954:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787360111.166078:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787360111.166932:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787360111.166988:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.167023:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.167033:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.167080:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.167111:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 46 pid: 6531 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.167130:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596072576:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360111.167279:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360111.172708:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596072576:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360111.172760:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360111.176958:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.178691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575023360 00000100:00100000:0.0:1787360111.178710:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575023360 00010000:00010000:0.0:1787360111.178773:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 47 pid: 6531 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.178843:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:0.0:1787360111.178866:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+47:2399:x1874182575023360:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360111.178887:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360111.178915:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 47 pid: 6531 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.178932:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 47 pid: 6531 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.178961:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72072c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef120 expref: 47 pid: 6531 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.178983:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:0.0:1787360111.178990:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.179002:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.179011:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.179059:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360111.179283:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+46:2399:x1874182575023360:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 283us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.179294:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00010000:00010000:1.0:1787360111.181000:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.181017:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360111.181684:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787360111.181947:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787360111.182083:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904191f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596072704:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787360111.182304:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360111.182601:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360111.182656:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596072704 00000100:00100000:0.0:1787360111.182665:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596072704 00000100:00100000:0.0:1787360111.182801:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787360111.182812:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596072704:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787360111.182939:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596072704:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.182961:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787360111.183079:0:6535:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1787360111.183087:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1787360111.183110:0:6535:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998903b3f100, transno 4294967302 00000100:00100000:3.0:1787360111.183133:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904191f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596072704:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787360111.183457:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1787360111.183540:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596072832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787360111.183583:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360111.183651:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360111.184080:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596072832 00000100:00100000:1.0:1787360111.184087:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596072832 00000100:00100000:1.0:1787360111.184168:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787360111.184178:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6535:x1874182596072832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787360111.184364:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1874182596072832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (778us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787360111.184372:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787360111.184548:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596072832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787360111.184607:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1787360111.184666:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184677:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184685:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184692:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360111.184697:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184705:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184723:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:3.0:1787360111.184726:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787360111.184731:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.184737:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720787 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787360111.184858:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787360111.185037:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787360111.185050:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389431823780ns, next at 390431821164ns, rc = 0 00000001:00080000:3.0:1787360111.185057:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1787360111.185083:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6b00) 00010000:00010000:3.0:1787360111.185087:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787360111.185094:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720772 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef143 expref: 50 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360111.185261:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20565c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+49:11368:x1874182575023232:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 20259us (20659us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787360111.185272:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000020:00080000:3.0:1787360111.185277:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1787360111.185672:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360111.189521:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.189648:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575023488 00000100:00100000:1.0:1787360111.189660:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575023488 00000100:00100000:1.0:1787360111.189797:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:1.0:1787360111.189809:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+49:11368:x1874182575023488:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360111.189839:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.189877:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72078e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef14a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.189952:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72078e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef14a expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.189970:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72078e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef14a expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.189992:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.189996:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360111.190000:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360111.190088:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+50:11368:x1874182575023488:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 281us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.190096:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 111 00000100:00100000:2.0:1787360111.194006:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360111.194067:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575023744 00000100:00100000:3.0:1787360111.194083:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575023744 00000100:00100000:3.0:1787360111.194211:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1787360111.194261:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+50:11368:x1874182575023744:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360111.194549:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+51:11368:x1874182575023744:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 327us (555us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787360111.194557:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:3.0:1787360111.275200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.275718:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575023872 00000100:00100000:0.0:1787360111.275736:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575023872 00000100:00100000:0.0:1787360111.275898:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:0.0:1787360111.275913:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+51:11378:x1874182575023872:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360111.276019:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276040:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276054:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276068:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276076:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276083:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276220:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276269:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276276:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360111.276359:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276375:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276382:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276407:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276414:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeea00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360111.276419:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276427:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276441:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:0.0:1787360111.276445:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360111.276450:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276457:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720795 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276473:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276480:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276492:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276498:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360111.276502:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276508:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276517:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:0.0:1787360111.276519:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360111.276522:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276528:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee72079c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276539:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276545:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276552:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276556:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360111.276560:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276577:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276586:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360111.276588:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360111.276591:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.276597:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.276715:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+51:11378:x1874182575023872:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 804us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.276725:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 112 00000100:00100000:2.0:1787360111.336560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.336742:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575024128 00000100:00100000:1.0:1787360111.336756:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575024128 00000100:00100000:1.0:1787360111.336876:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:1.0:1787360111.336889:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+51:11381:x1874182575024128:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360111.336917:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.336944:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef151 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337038:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337057:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337070:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337085:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337092:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337098:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337837:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337881:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.337894:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360111.337914:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787360111.340075:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340092:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340100:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340106:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360111.340111:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340118:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340133:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360111.340136:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360111.340141:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340152:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7207b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340303:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340322:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340328:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340333:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360111.340336:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340342:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340351:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360111.340353:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360111.340356:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340361:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340652:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 54 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340668:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 53 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.340676:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.340679:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360111.340687:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71c00, rc 0) 00000100:00100000:1.0:1787360111.340759:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+53:11381:x1874182575024128:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 3872us (4211us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787360111.340768:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 113 00000100:00100000:2.0:1787360111.348677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.348818:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575024256 00000100:00100000:1.0:1787360111.348832:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575024256 00000100:00100000:1.0:1787360111.348917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:1.0:1787360111.349045:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+53:11381:x1874182575024256:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1787360111.349135:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349215:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349340:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349390:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349398:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349406:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349412:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360111.349417:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349424:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349457:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.349461:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360111.349467:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.349473:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360111.350546:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+53:11381:x1874182575024256:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 1607us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.350561:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 114 00000100:00100000:3.0:1787360111.362218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.362352:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575024512 00000100:00100000:1.0:1787360111.362371:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575024512 00000100:00100000:1.0:1787360111.362453:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:1.0:1787360111.362467:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+53:11381:x1874182575024512:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360111.362742:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+54:11381:x1874182575024512:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 278us (533us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787360111.362750:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1787360111.460778:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.460913:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575024768 00000100:00100000:0.0:1787360111.460926:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575024768 00000100:00100000:0.0:1787360111.461260:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:0.0:1787360111.461274:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+54:11391:x1874182575024768:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360111.461309:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360111.461313:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787360111.461345:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee72074f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef135 expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461370:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:0.0:1787360111.461376:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360111.461394:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef158 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461566:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461583:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 54 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461592:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461635:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 54 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.461652:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 54 pid: 6532 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.461668:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596072960:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360111.461797:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360111.465770:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596072960:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360111.465810:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360111.467353:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.467429:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575024896 00000100:00100000:1.0:1787360111.467444:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575024896 00010000:00010000:1.0:1787360111.467508:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 55 pid: 6532 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360111.467558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:1.0:1787360111.467569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+55:2400:x1874182575024896:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360111.467586:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360111.467610:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 55 pid: 6532 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467623:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 55 pid: 6532 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467647:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef151 expref: 55 pid: 6532 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467663:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.467668:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467678:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467685:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.467717:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360111.467782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+54:2400:x1874182575024896:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.467789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00010000:00010000:0.0:1787360111.468453:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.468467:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360111.468496:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787360111.468674:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7207d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 55 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.468692:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 54 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.468700:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360111.468703:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360111.468706:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef800, rc 0) 00000100:00100000:0.0:1787360111.468800:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+54:11391:x1874182575024768:12345-192.168.206.11@tcp:101:bash.0 Request processed in 7529us (8036us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787360111.468809:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:3.0:1787360111.473282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.473383:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025024 00000100:00100000:1.0:1787360111.473400:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025024 00000100:00100000:1.0:1787360111.473488:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:1.0:1787360111.473501:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+54:11391:x1874182575025024:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360111.473534:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.473561:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef15f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473627:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473644:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473657:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473806:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 56 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473829:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.473839:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.473843:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360111.473860:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:1.0:1787360111.473983:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+55:11391:x1874182575025024:12345-192.168.206.11@tcp:101:bash.0 Request processed in 483us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.473992:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:3.0:1787360111.488044:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.488306:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025280 00000100:00100000:1.0:1787360111.488320:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025280 00000100:00100000:1.0:1787360111.488412:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1787360111.488424:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+55:11391:x1874182575025280:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:1.0:1787360111.488698:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.488740:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.488753:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360111.488802:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787360111.488826:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007944b503 reply state 00000000c7d2f871 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.488839:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.488858:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.488862:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360111.488866:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360111.488981:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+58:11391:x1874182575025280:12345-192.168.206.11@tcp:36:bash.0 Request processed in 557us (951us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787360111.488989:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000020:00080000:1.0:1787360111.488995:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787360111.502794:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.503620:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025408 00000100:00100000:1.0:1787360111.503634:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025408 00000100:00100000:1.0:1787360111.503732:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:1.0:1787360111.503743:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+58:11391:x1874182575025408:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360111.503771:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.503794:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef166 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.503915:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.503952:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 59 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.503962:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.504005:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 59 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.504021:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 59 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360111.504036:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073088:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360111.506278:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360111.515603:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.515802:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073088:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360111.515838:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.516881:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025536 00000100:00100000:2.0:1787360111.516894:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025536 00010000:00010000:2.0:1787360111.517041:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 60 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.517094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360111.517104:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+60:2400:x1874182575025536:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360111.517123:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360111.517131:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 60 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517198:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 60 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517278:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee7207db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef158 expref: 60 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517299:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360111.517305:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517316:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517325:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.517347:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360111.517414:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+59:2400:x1874182575025536:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 311us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360111.517421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00010000:00010000:1.0:1787360111.518095:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.518107:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360111.518363:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787360111.518368:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360111.518396:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.518454:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee7207fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 59 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.518475:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 58 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.518485:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.518488:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360111.518887:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:1.0:1787360111.519652:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+58:11391:x1874182575025408:12345-192.168.206.11@tcp:101:bash.0 Request processed in 15904us (16865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.519663:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:3.0:1787360111.527060:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.529754:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025792 00000100:00100000:0.0:1787360111.529774:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025792 00000100:00100000:0.0:1787360111.533264:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:0.0:1787360111.533301:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+58:11391:x1874182575025792:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:0.0:1787360111.533637:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+59:11391:x1874182575025792:12345-192.168.206.11@tcp:35:bash.0 Request processed in 354us (6589us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787360111.533646:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:3.0:1787360111.680462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360111.681054:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575025920 00000100:00100000:2.0:1787360111.681068:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575025920 00000100:00100000:2.0:1787360111.681207:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:2.0:1787360111.681221:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+59:11397:x1874182575025920:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360111.681280:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360111.681308:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee72080c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef16d expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681395:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681411:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681424:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360111.681488:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787360111.681492:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360111.681514:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681543:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee72080c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef16d expref: 61 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681564:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef16d expref: 60 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.681574:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360111.681578:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360111.681599:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041800, rc 0) 00000100:00100000:2.0:1787360111.681687:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575025920:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 468us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360111.681696:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:0.0:1787360111.686914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.692091:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026048 00000100:00100000:1.0:1787360111.692112:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026048 00000100:00100000:1.0:1787360111.692256:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1787360111.692270:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575026048:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360111.692297:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360111.692325:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72081a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef174 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692409:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692427:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692439:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692474:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692483:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692491:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692586:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692596:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692603:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360111.692659:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787360111.692665:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360111.692687:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692701:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692710:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692718:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692736:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692742:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360111.692747:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692755:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692770:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:1.0:1787360111.692773:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360111.692779:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692786:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720821 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692803:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692809:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692815:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692821:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360111.692824:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692839:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692859:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:1.0:1787360111.692861:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360111.692864:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692870:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692901:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71c00/0x359a4e2aee72081a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 62 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692916:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.692925:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.692927:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360111.692941:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680000, rc 0) 00000100:00100000:1.0:1787360111.695198:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+61:11397:x1874182575026048:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 2915us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.695213:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:3.0:1787360111.701635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.704357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360111.704519:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026304 00000100:00100000:2.0:1787360111.704531:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026304 00000100:00100000:2.0:1787360111.704605:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:2.0:1787360111.704618:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+61:11397:x1874182575026304:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360111.704648:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360111.704676:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720836 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef17b expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.704823:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.704841:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 62 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.704861:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 62 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.704870:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.704912:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 62 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.705044:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 62 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.705086:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073216:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360111.705306:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 62 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360111.705318:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 62 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.705328:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073344:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360111.705366:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:1.0:1787360111.705991:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026432 00000100:00100000:1.0:1787360111.706002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026432 00010000:00010000:1.0:1787360111.706040:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 63 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360111.706172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:1.0:1787360111.706183:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+63:2400:x1874182575026432:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360111.706197:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360111.706206:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 63 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.706220:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 63 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.706262:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.706267:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.706277:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.706284:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360111.706321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+63:2400:x1874182575026432:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 140us (4700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.706491:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:3.0:1787360111.711834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360111.712285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026560 00000100:00100000:0.0:1787360111.712297:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026560 00010000:00010000:0.0:1787360111.712359:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 63 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.712406:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:0.0:1787360111.712436:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+63:2400:x1874182575026560:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360111.712456:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360111.712463:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 63 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.712479:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 63 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.712517:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360111.712523:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.712536:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.712545:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.712566:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360111.712628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+63:2400:x1874182575026560:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 194us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.712636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00010000:00010000:2.0:1787360111.713717:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef166 expref: 62 pid: 11098 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360111.713959:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073344:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360111.714157:0:11098:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.11@tcp) returned -22 from blocking AST (req@00000000f512e3e5 x1874182596073216) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 61 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.714178:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72082f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef174 expref: 61 pid: 6533 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360111.714486:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596073216:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360111.714514:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360111.714523:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.714534:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.714541:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360111.714567:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787360111.714887:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 62 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.715161:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 61 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360111.715171:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360111.715173:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360111.715176:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040400, rc 0) 00000100:00100000:0.0:1787360111.715833:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+61:11397:x1874182575026304:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 11213us (11495us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787360111.715872:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:0.0:1787360111.720324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.720396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026816 00000100:00100000:1.0:1787360111.720409:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026816 00000100:00100000:1.0:1787360111.720503:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1787360111.720515:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+61:11397:x1874182575026816:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:1.0:1787360111.720536:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360111.720567:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee72078e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef14a expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.720607:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360111.720613:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360111.720691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575026816:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.720699:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1787360111.731084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360111.731248:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575026944 00000100:00100000:1.0:1787360111.731262:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575026944 00000100:00100000:1.0:1787360111.731354:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:1.0:1787360111.731368:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575026944:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:1.0:1787360111.731564:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.731585:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360111.731599:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360111.731730:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787360111.731820:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575026944:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 454us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360111.731829:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:0.0:1787360111.736426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360111.739757:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027072 00000100:00100000:3.0:1787360111.739777:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027072 00000100:00100000:3.0:1787360111.739892:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:3.0:1787360111.739905:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+60:11397:x1874182575027072:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360111.739931:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360111.739959:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef182 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740030:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740042:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740067:0:6531:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740082:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740098:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:3.0:1787360111.740101:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360111.740105:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 61 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360111.740114:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9400, rc 0) 00000100:00100000:3.0:1787360111.740309:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+61:11397:x1874182575027072:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 406us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360111.740317:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 123 00010000:00010000:1.0:1787360111.740644:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360111.868028:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360111.868086:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596073472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360111.868198:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787360111.868424:0:8769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390115197129ns, next at 391115193494ns, rc = 0 00000100:00100000:2.0:1787360111.868610:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596073472 00000100:00100000:2.0:1787360111.868620:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596073472 00000100:00100000:2.0:1787360111.868707:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787360111.868719:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596073472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360111.868754:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360111.868814:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596073472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360111.868822:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787360111.868906:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360111.868927:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596073600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360111.868963:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360111.869041:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360111.869086:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596073600 00000100:00100000:2.0:1787360111.869091:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596073600 00000100:00100000:2.0:1787360111.869139:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787360111.869146:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596073600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360111.869158:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360111.869189:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596073600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360111.869195:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787360111.869277:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596073600:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787360111.869348:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360111.869744:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596073472:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1787360112.569805:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360112.569826:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360112.570002:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787360112.570013:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787360112.570200:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596073728:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787360112.570495:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.578025:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596073728:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360112.580049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.582141:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027200 00000100:00100000:1.0:1787360112.582162:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027200 00000100:00100000:1.0:1787360112.582319:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00080000:2.0:1787360112.582490:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360112.582881:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+61:11398:x1874182575027200:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787360112.582927:0:11098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787360112.583088:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+61:11398:x1874182575027200:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 756us (3049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360112.583098:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1787360112.590200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.591147:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027328 00000100:00100000:2.0:1787360112.591164:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027328 00000100:00100000:2.0:1787360112.591273:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:2.0:1787360112.591286:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+61:11398:x1874182575027328:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.591395:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.591417:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.591432:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592612:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592637:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592650:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592679:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592702:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.592710:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360112.593432:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787360112.593436:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360112.593461:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593476:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593483:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593489:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593495:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.593500:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593507:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593524:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:2.0:1787360112.593527:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.593531:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593550:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041a00/0x359a4e2aee720859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593566:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593571:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593577:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593581:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.593584:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593589:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593596:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff998a227ada00) 00010000:00010000:2.0:1787360112.593599:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.593601:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593607:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040a00/0x359a4e2aee720860 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593622:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593628:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593641:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593646:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.593649:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593655:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593663:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.593666:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.593668:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.593673:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041000/0x359a4e2aee720867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.593783:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+61:11398:x1874182575027328:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 2496us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.593793:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:0.0:1787360112.597701:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.597798:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027584 00000100:00100000:2.0:1787360112.597812:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027584 00000100:00100000:2.0:1787360112.597907:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1787360112.597919:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+61:11398:x1874182575027584:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.597939:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360112.597960:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72086e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef189 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598092:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598108:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598118:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360112.598128:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787360112.598200:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598207:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598213:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598218:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.598222:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598261:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598272:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.598275:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787360112.598280:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598295:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720875 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598335:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72086e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef189 expref: 63 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598345:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:2.0:1787360112.598347:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360112.598364:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72086e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef189 expref: 63 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.598375:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:2.0:1787360112.598669:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575027584:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 752us (992us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1787360112.598676:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:0.0:1787360112.606990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.607315:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027712 00000100:00100000:1.0:1787360112.607326:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027712 00000100:00100000:1.0:1787360112.607536:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1787360112.607546:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575027712:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787360112.607585:0:11098:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787360112.607705:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575027712:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 160us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360112.607712:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:1.0:1787360112.612361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.612720:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575027968 00000100:00100000:2.0:1787360112.612733:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575027968 00000100:00100000:2.0:1787360112.613038:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:2.0:1787360112.613051:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575027968:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.613077:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360112.613081:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787360112.613126:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041800/0x359a4e2aee720813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef16d expref: 62 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.613151:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360112.613158:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360112.613189:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720883 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef190 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360112.613723:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787360112.615004:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72088a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.615027:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72088a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.615040:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72088a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.615140:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720883 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef190 expref: 64 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.615164:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72088a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef190 expref: 63 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.615173:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360112.615176:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360112.615179:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:2.0:1787360112.615294:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+63:11398:x1874182575027968:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2244us (2945us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787360112.615303:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:0.0:1787360112.622923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.623106:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575028224 00000100:00100000:2.0:1787360112.623120:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575028224 00000100:00100000:2.0:1787360112.623204:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:2.0:1787360112.623217:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+63:11398:x1874182575028224:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.623359:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360112.623400:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72088a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef190 expref: 63 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623425:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360112.623438:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360112.623463:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623479:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623502:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623519:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623527:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623534:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623588:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623596:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623603:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623616:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.623621:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623630:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623640:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360112.623643:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.623647:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623654:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720898 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623664:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623671:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623677:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623682:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.623685:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623692:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623710:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x63250d9b (ffff998a227ad100) 00010000:00010000:2.0:1787360112.623712:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.623715:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.623722:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72089f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x63250d9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.623831:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575028224:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 607us (913us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360112.623848:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:0.0:1787360112.631121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.631219:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575028352 00000100:00100000:1.0:1787360112.631258:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575028352 00000100:00100000:1.0:1787360112.631325:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:1.0:1787360112.631708:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+62:11398:x1874182575028352:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360112.631734:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360112.631762:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7208a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef197 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.631806:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.631822:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.631835:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.631977:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7208a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 64 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.632000:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 63 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.632010:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:1.0:1787360112.632013:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360112.632017:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:1.0:1787360112.632166:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+63:11398:x1874182575028352:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 462us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360112.632175:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:0.0:1787360112.635407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.635656:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575028608 00000100:00100000:2.0:1787360112.635672:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575028608 00000100:00100000:2.0:1787360112.635749:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:2.0:1787360112.635762:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+63:11398:x1874182575028608:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.635882:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.635903:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.635917:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360112.636605:0:9449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1787360112.636678:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ffe2eee reply state 000000002359fbb2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.636698:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.636724:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.636727:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787360112.636733:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360112.636873:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+65:11398:x1874182575028608:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 1111us (1476us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787360112.636883:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 131 00000100:00100000:3.0:1787360112.639108:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.639658:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575028736 00000100:00100000:2.0:1787360112.639671:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575028736 00000100:00100000:2.0:1787360112.639793:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:2.0:1787360112.639806:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+65:11398:x1874182575028736:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.639835:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360112.639870:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef19e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.639939:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.639957:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 66 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.639978:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.639981:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360112.639986:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:2.0:1787360112.640056:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+66:11398:x1874182575028736:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 253us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.640064:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:0.0:1787360112.642272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.642378:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575028864 00000100:00100000:3.0:1787360112.642390:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575028864 00000100:00100000:3.0:1787360112.642478:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1787360112.642500:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575028864:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787360112.642758:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575028864:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 268us (534us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787360112.642766:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00080000:0.0:1787360112.642973:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360112.644979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.645180:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575029120 00000100:00100000:3.0:1787360112.645191:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575029120 00000100:00100000:3.0:1787360112.645274:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:3.0:1787360112.645285:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+66:11398:x1874182575029120:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360112.645685:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+67:11398:x1874182575029120:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 399us (715us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787360112.645693:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:3.0:1787360112.648953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.649474:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575029376 00000100:00100000:0.0:1787360112.649611:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575029376 00000100:00100000:0.0:1787360112.649747:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:0.0:1787360112.649760:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+67:11398:x1874182575029376:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787360112.649931:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+67:11398:x1874182575029376:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 173us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360112.649939:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:0.0:1787360112.653510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.653816:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575029504 00000100:00100000:2.0:1787360112.653829:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575029504 00000100:00100000:2.0:1787360112.653910:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:2.0:1787360112.653920:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+67:11398:x1874182575029504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.653944:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360112.653969:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7208c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1a5 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654051:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654068:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654081:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360112.654133:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360112.654153:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654192:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee7208c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1a5 expref: 69 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654214:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1a5 expref: 68 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.654269:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.654272:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787360112.654276:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:2.0:1787360112.654363:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+68:11398:x1874182575029504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 445us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.654371:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:1.0:1787360112.658595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.658848:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575029632 00000100:00100000:3.0:1787360112.658862:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575029632 00000100:00100000:3.0:1787360112.658939:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1787360112.658950:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575029632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360112.658974:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360112.659006:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1ac expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360112.659161:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f370, blocks: 0x0 00010000:00010000:3.0:1787360112.659183:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1787360112.659188:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360112.659199:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 10 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.659423:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 10 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.659445:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9600, rc 0) 00000100:00100000:3.0:1787360112.659565:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+10:2400:x1874182575029632:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 616us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360112.659573:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1787360112.662894:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.663023:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575029888 00000100:00100000:2.0:1787360112.663034:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575029888 00000100:00100000:2.0:1787360112.663108:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:2.0:1787360112.663120:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+68:11398:x1874182575029888:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787360112.663301:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+68:11398:x1874182575029888:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 182us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.663310:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:3.0:1787360112.669590:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.669890:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030016 00000100:00100000:1.0:1787360112.669921:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030016 00000100:00100000:1.0:1787360112.669991:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1787360112.670002:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+10:11398:x1874182575030016:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360112.670023:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360112.670044:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1b3 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.670082:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.670092:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360112.670097:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360112.670103:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.670156:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.670172:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.670198:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1874182596073856:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360112.670348:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360112.673071:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1874182596073856:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360112.673116:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.673151:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:3.0:1787360112.673385:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+11:11398:x1874182575030016:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 3384us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360112.673396:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:3.0:1787360112.674807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.675027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030144 00000100:00100000:1.0:1787360112.675038:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030144 00010000:00010000:1.0:1787360112.675090:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.675196:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:1.0:1787360112.675210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+11:2400:x1874182575030144:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360112.675258:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360112.675285:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.675301:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.675328:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee7208d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ac expref: 11 pid: 8448 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.675359:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360112.675364:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360112.675374:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.675386:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.675435:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.675452:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874182596073984:192.168.206.11@tcp:105: 00000100:00100000:1.0:1787360112.675560:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.684163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.684264:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874182596073984:192.168.206.11@tcp:105: 00000100:00100000:3.0:1787360112.684271:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030272 00000100:00100000:3.0:1787360112.684280:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030272 00010000:00010000:0.0:1787360112.684294:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1787360112.684350:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff998904191180 x1874182575030272/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:303/0 lens 504/0 e 0 to 0 dl 1787360123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360112.684361:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904191180 with x1874182575030272 ext(0->12) 00002000:00010000:3.0:1787360112.684367:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998904191180 00000100:00100000:0.0:1787360112.684370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+11:2400:x1874182575030144:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 9163us (9572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360112.684380:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 74 00000100:00100000:3.0:1787360112.684393:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:3.0:1787360112.684404:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+11:2399:x1874182575030272:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787360112.688445:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+12:2399:x1874182575030272:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 4026us (4282us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787360112.688463:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00002000:00100000:0.0:1787360112.688481:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff998904191180 x1874182575030272/t4294967309(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:303/0 lens 504/448 e 0 to 0 dl 1787360123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360112.688493:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904191180 with x1874182575030272 ext(0->12) 00002000:00010000:0.0:1787360112.688501:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998904191180 00000100:00100000:1.0:1787360112.690694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.690798:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030400 00000100:00100000:0.0:1787360112.690811:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030400 00000100:00100000:0.0:1787360112.690931:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:0.0:1787360112.690944:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+68:11398:x1874182575030400:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787360112.700064:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787360112.700088:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787360112.700133:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787360112.700158:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998a3502c6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787360112.700166:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a3c9f7800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998a3502c300 00010000:00010000:3.0:1787360112.700167:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360112.700180:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a3c9f7400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998a3ca3e400 00010000:00010000:3.0:1787360112.700197:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700208:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360112.700212:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:3.0:1787360112.700269:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.700277:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360112.700287:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998a012edd80 refcount 2 committed 0 result 0 batchid 2 00010000:00010000:3.0:1787360112.700288:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360112.700300:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a350a8800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998a012ed480 00000020:00080000:1.0:1787360112.700307:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a350a8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998903b4e200 00010000:00010000:3.0:1787360112.700320:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff998902719900) 00010000:00010000:3.0:1787360112.700325:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360112.700653:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360112.700679:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596074112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787360112.700768:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360112.700804:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700813:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee7205dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.700828:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:11398:x1874182575030400:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 9881us (10139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360112.700861:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00010000:00010000:3.0:1787360112.700891:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700901:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700908:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700913:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.700917:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700924:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700937:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff998902719c00) 00010000:00010000:3.0:1787360112.700940:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360112.700943:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700950:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720684 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700969:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700975:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700981:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.700993:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.700998:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701004:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701014:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:3.0:1787360112.701016:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360112.701020:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701026:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720702 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.701042:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787360112.701043:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701057:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701063:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.701067:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596074240:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787360112.701076:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.701082:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701089:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701112:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a28ed6800) 00010000:00010000:3.0:1787360112.701114:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360112.701117:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701124:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720725 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701141:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701148:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701154:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701159:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.701162:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701167:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701175:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:3.0:1787360112.701177:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360112.701191:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701198:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee7207f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701359:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701365:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701371:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701377:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360112.701379:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701386:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701408:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:3.0:1787360112.701411:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360112.701414:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.701420:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee7208b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787360112.701446:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787360112.701524:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787360112.704490:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596074112 00000100:00100000:3.0:1787360112.704511:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596074112 00000100:00100000:3.0:1787360112.704594:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360112.704607:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596074112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787360112.704669:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1787360112.704732:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a88f36e, atime: 0x6a88f36f, ctime: 0x6a88f36e, blocks: 0x8 00010000:00010000:3.0:1787360112.704741:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.704769:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1787360112.704774:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360112.704781:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.704807:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.704818:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.704831:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.704873:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360112.706013:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360112.706028:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.706041:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360112.706046:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.706057:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.706084:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.706106:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee7208de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.706131:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360112.706133:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360112.706135:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360112.709675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.709926:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030528 00000100:00100000:0.0:1787360112.709942:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030528 00000100:00100000:0.0:1787360112.710013:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:0.0:1787360112.710024:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+12:2399:x1874182575030528:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787360112.710789:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360112.710880:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596074112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6269us (10106us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787360112.710897:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360112.710928:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596074240 00000100:00100000:3.0:1787360112.710936:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596074240 00000100:00100000:3.0:1787360112.710988:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787360112.710997:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3536bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596074240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787360112.711047:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1787360112.711079:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.711106:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.711117:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787360112.711122:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360112.711127:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.711190:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.711212:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 12 pid: 8447 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.711256:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1874182596074368:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360112.711359:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeae300 going to sleep for 11 seconds 00000004:00080000:2.0:1787360112.711880:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998903b85500/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787360112.711890:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596074112:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787360112.713301:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787360112.713334:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1787360112.713506:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575030528:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 3474us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360112.713520:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1787360112.717386:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1874182596074368:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360112.717427:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.717664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.718009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030656 00000100:00100000:1.0:1787360112.718019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030656 00010000:00010000:1.0:1787360112.718068:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.718115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 75 00000100:00100000:1.0:1787360112.718127:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575030656:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360112.718145:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360112.718152:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718176:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718207:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee720692 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef10b expref: 7 pid: 8447 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718267:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360112.718273:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360112.718279:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718290:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718322:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360112.718405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575030656:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 278us (740us total) trans 0 rc 0/0 00010000:00010000:3.0:1787360112.718410:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.718416:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 75 00010000:00010000:3.0:1787360112.718427:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.718440:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.718450:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.718477:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360112.718663:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360112.718672:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.718676:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3536bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596074240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7678us (7889us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787360112.718685:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787360112.718749:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360112.718756:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718780:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718795:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718803:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee7208e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.718827:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360112.718829:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360112.718832:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360112.718916:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787360112.718923:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787360112.718944:0:3658:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99890434c700 x1874182596074240/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787360128 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787360112.718956:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99890434c700/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787360112.718976:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596074240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787360112.728416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.728509:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575030912 00000100:00100000:1.0:1787360112.728522:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575030912 00000100:00100000:1.0:1787360112.728609:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:1.0:1787360112.728622:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+16:11398:x1874182575030912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787360112.728698:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360112.728736:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee7208c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1a5 expref: 16 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.728761:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:1.0:1787360112.728767:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360112.728807:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.728823:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.728862:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360112.729197:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000884d0f46 reply state 0000000084bb6c14 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.729212:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.729219:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:1.0:1787360112.729222:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360112.729284:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360112.729588:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+17:11398:x1874182575030912:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 968us (1186us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1787360112.729605:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1787360112.738851:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.739021:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031040 00000100:00100000:2.0:1787360112.739033:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031040 00000100:00100000:2.0:1787360112.739098:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1787360112.739108:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575031040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787360112.739370:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787360112.739374:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787360111 00002000:00010000:2.0:1787360112.739377:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787360111 00002000:00010000:2.0:1787360112.739379:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787360112 -> 1787360111 00002000:00010000:2.0:1787360112.739500:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787360112.739584:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575031040:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 477us (756us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787360112.739593:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1787360112.751167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.752071:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031296 00000100:00100000:0.0:1787360112.752085:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031296 00000100:00100000:0.0:1787360112.752179:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:0.0:1787360112.752190:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+17:11398:x1874182575031296:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787360112.752317:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.752338:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 17 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.752351:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.752431:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 17 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.752446:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 17 pid: 11098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.752462:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596074496:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360112.752562:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360112.759907:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596074496:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360112.759947:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.761429:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360112.762325:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.763302:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031424 00000100:00100000:3.0:1787360112.763319:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031424 00010000:00010000:3.0:1787360112.763454:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 18 pid: 11098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.763620:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:3.0:1787360112.763633:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+18:2400:x1874182575031424:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360112.763652:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360112.763661:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 18 pid: 11098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763688:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 18 pid: 11098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763716:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7208ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef197 expref: 18 pid: 11098 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763737:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:3.0:1787360112.763743:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763755:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763763:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.763797:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360112.764058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+17:2400:x1874182575031424:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 425us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360112.764068:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00010000:00010000:2.0:1787360112.764623:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764636:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764696:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764705:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764713:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764721:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.764726:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764734:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764768:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.764771:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787360112.764776:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.764783:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee7208f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.764883:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+16:11398:x1874182575031296:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 12691us (13812us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787360112.764892:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:2.0:1787360112.769981:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.770060:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031552 00000100:00100000:3.0:1787360112.770087:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031552 00000100:00100000:3.0:1787360112.770160:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:3.0:1787360112.770173:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575031552:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787360112.770268:0:8770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.770294:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.770304:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787360112.770310:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360112.770315:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.770359:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 7 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.770375:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 7 pid: 8447 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.770589:0:8770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1874182596074624:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360112.770943:0:8770:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2eeaef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.782257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.782764:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031680 00000100:00100000:2.0:1787360112.782778:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031680 00010000:00010000:2.0:1787360112.782830:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 8 pid: 8447 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.782896:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:2.0:1787360112.782909:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575031680:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360112.782927:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360112.782954:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 8 pid: 8447 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.782971:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 8 pid: 8447 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.783005:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360112.783022:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360112.783030:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.783042:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.783067:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360112.783143:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575031680:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 236us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.783152:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00010000:00010000:3.0:1787360112.785774:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f49daf/0x359a4e2aee7208d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1b3 expref: 7 pid: 8447 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.785803:0:8770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8770:1874182596074624:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360112.785861:0:8770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788430:0:8770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788455:0:8770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788504:0:8770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788514:0:8770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788523:0:8770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788530:0:8770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360112.788536:0:8770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788545:0:8770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788570:0:8770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360112.788611:0:8770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000167a088e/0x359a4e2aee7208fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360112.788752:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2401:x1874182575031552:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 18574us (18777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360112.788765:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:1.0:1787360112.804076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.804199:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575031936 00000100:00100000:2.0:1787360112.804211:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575031936 00000100:00100000:2.0:1787360112.804323:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1787360112.804335:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+16:11398:x1874182575031936:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787360112.804673:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.804694:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.804706:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.804747:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.804764:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 16 pid: 6532 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.804801:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904080000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596074752:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360112.806306:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989034789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.816853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.816976:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032064 00000100:00100000:2.0:1787360112.816987:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032064 00010000:00010000:2.0:1787360112.817038:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 17 pid: 6532 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.817087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:2.0:1787360112.817098:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+17:2400:x1874182575032064:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360112.817118:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360112.817126:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 17 pid: 6532 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817142:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 17 pid: 6532 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817171:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.817178:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817189:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817199:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817207:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.817271:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360112.817379:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+17:2400:x1874182575032064:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 281us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.817396:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00010000:00010000:0.0:1787360112.818546:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee7207f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef15f expref: 16 pid: 6532 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.818580:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904080000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596074752:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360112.818610:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818620:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818626:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818876:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818892:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818921:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.818964:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.819430:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 16 pid: 6531 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.819452:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596074880:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360112.819547:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.822358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.822540:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032192 00000100:00100000:2.0:1787360112.822552:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032192 00010000:00010000:2.0:1787360112.822608:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 17 pid: 6531 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.822651:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:2.0:1787360112.822663:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+17:2399:x1874182575032192:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360112.822682:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360112.822691:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 17 pid: 6531 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.822707:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 17 pid: 6531 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.822734:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.822740:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.822751:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.822760:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.822801:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360112.822881:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+17:2399:x1874182575032192:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 220us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.822889:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 79 00010000:00010000:0.0:1787360112.824744:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee7208bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef19e expref: 16 pid: 6531 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.824775:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596074880:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360112.824803:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.824812:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360112.824818:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360112.825044:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787360112.825517:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1787360112.825559:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787360112.825687:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874182596075008:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787360112.825772:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360112.825814:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.825888:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596075008 00000100:00100000:1.0:1787360112.825898:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596075008 00000100:00100000:1.0:1787360112.826030:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787360112.826041:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6532:x1874182596075008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787360112.826264:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6532:x1874182596075008:12345-0@lo:1000:mdt00_001.0 Request processed in 224us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360112.826272:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787360112.826806:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874182596075008:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787360112.827073:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787360112.827148:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904080000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874182596075136:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787360112.827201:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360112.827387:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.828521:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596075136 00000100:00100000:1.0:1787360112.828555:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596075136 00000100:00100000:1.0:1787360112.828630:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787360112.828649:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6532:x1874182596075136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787360112.828961:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6532:x1874182596075136:12345-0@lo:1000:mdt00_001.0 Request processed in 315us (1758us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787360112.828971:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787360112.829061:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904080000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1874182596075136:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787360112.829128:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829141:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829149:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829156:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.829162:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829170:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829191:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.829194:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360112.829208:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.829215:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720908 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832487:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832509:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832517:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832523:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.832529:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832538:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832560:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.832564:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360112.832577:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832589:0:6532:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832599:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.832709:0:6532:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.832728:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596075264:192.168.206.11@tcp:105: 00000100:00100000:2.0:1787360112.833187:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360112.840200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360112.840334:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032320 00000100:00100000:0.0:1787360112.840346:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032320 00000100:00100000:0.0:1787360112.840846:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:0.0:1787360112.840862:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:11397:x1874182575032320:12345-192.168.206.11@tcp:49:lfs.0 00000100:00100000:2.0:1787360112.841374:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596075264:192.168.206.11@tcp:105: 00010000:00010000:2.0:1787360112.841600:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.841613:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee72084b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360112.841813:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:11397:x1874182575032320:12345-192.168.206.11@tcp:49:lfs.0 Request processed in 954us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360112.841824:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00010000:00010000:2.0:1787360112.841899:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.841918:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843028:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843050:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843057:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843065:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843096:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.843101:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843109:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843126:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.843129:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.843135:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843141:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72090f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843160:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843167:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843173:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843178:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.843181:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843188:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843207:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.843209:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360112.843212:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.843217:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee720901 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.844884:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:11398:x1874182575031936:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 40536us (40807us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787360112.844900:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000020:00080000:2.0:1787360112.844908:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787360112.845174:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360112.845180:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360112.845711:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787360112.845723:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787360112.869621:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.870112:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032576 00000100:00100000:2.0:1787360112.870126:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032576 00000100:00100000:2.0:1787360112.870204:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:2.0:1787360112.870217:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:11397:x1874182575032576:12345-192.168.206.11@tcp:58:lfs.0 00000040:00080000:2.0:1787360112.870449:0:11098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787360112.870684:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:11397:x1874182575032576:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 467us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.870694:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:3.0:1787360112.876800:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.877174:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032832 00000100:00100000:1.0:1787360112.877187:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032832 00000100:00100000:1.0:1787360112.877293:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:1.0:1787360112.877306:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20566c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:11398:x1874182575032832:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787360112.877827:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787360112.877994:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1787360112.878037:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878058:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878070:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878080:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878111:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878117:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.878308:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360112.878433:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20566c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:11398:x1874182575032832:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 1127us (1646us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787360112.878443:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000020:00080000:1.0:1787360112.878449:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787360112.885142:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360112.885164:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.885178:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360112.885183:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.885296:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.885323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360112.885396:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787360112.885404:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.885411:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720916 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.885437:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360112.885439:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360112.885442:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360112.913346:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360112.913587:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575032960 00000100:00100000:2.0:1787360112.913600:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575032960 00000100:00100000:2.0:1787360112.913676:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1787360112.913689:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:11400:x1874182575032960:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360112.913720:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360112.913747:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72091d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1ba expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914043:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914061:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914075:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914106:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914115:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914122:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914223:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914273:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 22 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914282:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914323:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 22 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.914578:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 22 pid: 11098 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360112.914596:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596075392:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360112.915004:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989034789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360112.920785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360112.921048:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575033216 00000100:00100000:3.0:1787360112.921060:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575033216 00000100:00100000:3.0:1787360112.921128:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1787360112.921142:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:6172:x1874182575033216:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787360112.921630:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+24:6172:x1874182575033216:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 489us (857us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787360112.921640:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:3.0:1787360112.926867:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360112.927273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575033344 00000100:00100000:1.0:1787360112.927286:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575033344 00010000:00010000:1.0:1787360112.927352:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 24 pid: 11098 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360112.927400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:1.0:1787360112.927413:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:2400:x1874182575033344:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360112.927432:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360112.927440:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 24 pid: 11098 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927456:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 24 pid: 11098 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927497:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee72083d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef17b expref: 24 pid: 11098 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927540:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:1.0:1787360112.927546:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927557:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927566:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360112.927591:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360112.927661:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+23:2400:x1874182575033344:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 250us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360112.927668:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:2.0:1787360112.929243:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596075392:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360112.929284:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929359:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929367:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360112.929440:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787360112.929445:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360112.929471:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929501:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929512:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929519:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929526:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929532:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.929536:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929544:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929561:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360112.929571:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.929577:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929584:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929603:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929609:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929616:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929621:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360112.929624:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929629:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929637:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff998a227ad600) 00010000:00010000:2.0:1787360112.929639:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360112.929642:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929647:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72092b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929693:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72091d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ba expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929723:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ba expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360112.929732:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360112.929734:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360112.929737:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517e00, rc 0) 00000100:00100000:2.0:1787360112.929807:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:11400:x1874182575032960:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 16119us (16584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360112.929816:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00010000:00010000:0.0:1787360113.788044:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360113.817479:0:14323:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360113.817495:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360113.817535:0:14323:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787360113.817545:0:14323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787360113.851106:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360113.851120:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360113.851164:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787360113.851186:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360113.851373:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596075520:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787360113.851811:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360113.862202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360113.862353:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575033472 00000100:00100000:3.0:1787360113.862364:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575033472 00000100:00100000:3.0:1787360113.862433:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:3.0:1787360113.862445:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+23:11412:x1874182575033472:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787360113.862494:0:6532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787360113.862636:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+23:11412:x1874182575033472:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360113.862644:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:2.0:1787360113.868661:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596075520:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787360113.874009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360113.874092:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575033728 00000100:00100000:3.0:1787360113.874113:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575033728 00000100:00100000:3.0:1787360113.874195:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:3.0:1787360113.874207:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+22:11412:x1874182575033728:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360113.874374:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360113.874403:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720939 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1c1 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.874674:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee720940 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.874692:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee720940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.874706:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee720940 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360113.874719:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787360113.875153:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720939 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c1 expref: 25 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.875186:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee720940 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c1 expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.875195:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:3.0:1787360113.875199:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360113.875202:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8200, rc 0) 00000100:00100000:3.0:1787360113.876053:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+24:11412:x1874182575033728:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1842us (2052us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787360113.876066:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:1.0:1787360113.884664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360113.884728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360113.884803:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575033856 00000100:00100000:2.0:1787360113.884839:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575033856 00000100:00100000:2.0:1787360113.884920:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:2.0:1787360113.884933:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+24:2402:x1874182575033856:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360113.884952:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360113.884983:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee720940 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c1 expref: 24 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360113.885003:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360113.885027:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360113.885089:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+23:2402:x1874182575033856:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 159us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360113.885098:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1787360113.888144:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034112 00000100:00100000:3.0:1787360113.888163:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034112 00000100:00100000:3.0:1787360113.888272:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:3.0:1787360113.888284:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+23:11412:x1874182575034112:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787360113.889552:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889582:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889595:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889779:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889789:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889796:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889982:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360113.889989:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.889999:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.890014:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:3.0:1787360113.890018:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787360113.890042:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360113.890049:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72094e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360113.890263:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+24:11412:x1874182575034112:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 1974us (5528us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787360113.890275:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000040:00080000:1.0:1787360113.890941:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360113.890949:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360113.893179:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787360113.893199:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360113.893743:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360113.894512:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034368 00000100:00100000:1.0:1787360113.894526:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034368 00000100:00100000:1.0:1787360113.894598:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:1.0:1787360113.894610:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:11412:x1874182575034368:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787360113.896048:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:11412:x1874182575034368:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 1431us (2302us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787360113.896080:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:3.0:1787360113.916051:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596075648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360113.916148:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360113.916304:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596075648 00000100:00100000:2.0:1787360113.916315:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596075648 00000100:00100000:2.0:1787360113.916391:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787360113.916403:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596075648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360113.916446:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360113.920531:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596075648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4116us (4369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360113.920549:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787360113.930257:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596075648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360114.536904:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.536955:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.536989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.537025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.537043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.537065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.537090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360114.537125:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034752 00000100:00100000:3.0:1787360114.537138:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034752 00000100:00100000:3.0:1787360114.537205:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035264 00000100:00100000:3.0:1787360114.537208:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035264 00000100:00100000:3.0:1787360114.537265:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034624 00000100:00100000:3.0:1787360114.537269:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034624 00000100:00100000:3.0:1787360114.537425:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035136 00000100:00100000:3.0:1787360114.537429:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035136 00000100:00100000:3.0:1787360114.537448:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:3.0:1787360114.537460:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575034752:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.537592:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 300 00000100:00100000:2.0:1787360114.537604:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575035264:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.537700:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575035264:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 100us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.537708:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 300 00000100:00100000:2.0:1787360114.537730:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:2.0:1787360114.537750:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+25:2400:x1874182575034624:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.537786:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+25:2400:x1874182575034624:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 49us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.537793:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 301 00000100:00100000:2.0:1787360114.537807:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 302 00000100:00100000:2.0:1787360114.537814:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575035136:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.537850:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575035136:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.537868:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 302 00000100:00100000:2.0:1787360114.537895:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035008 00000100:00100000:2.0:1787360114.537899:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035008 00000100:00100000:2.0:1787360114.537931:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034880 00000100:00100000:2.0:1787360114.537934:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034880 00000100:00100000:2.0:1787360114.537960:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:2.0:1787360114.537967:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575035008:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.537997:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575035008:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.538004:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:2.0:1787360114.538016:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:2.0:1787360114.538022:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575034880:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360114.538045:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575034880:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.538050:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:3.0:1787360114.539043:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575034752:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 1583us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360114.539054:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 299 00000100:00100000:1.0:1787360114.539522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575034496 00000100:00100000:1.0:1787360114.539532:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575034496 00000100:00100000:1.0:1787360114.539585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 385 00000100:00100000:1.0:1787360114.539595:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575034496:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360114.539630:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575034496:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 37us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360114.539637:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 385 00000100:00080000:0.0:1787360114.539929:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360114.539936:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360114.539940:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360114.539943:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787360114.809638:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360114.938038:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596076032:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938137:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938211:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596076544:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938273:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938300:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3b9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596077056:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938338:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938370:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787360114.938377:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596075904:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938436:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596076416:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938458:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938471:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3b9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596076928:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938493:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.938542:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076544 00000100:00100000:2.0:1787360114.938551:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076544 00000100:00100000:2.0:1787360114.938612:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077056 00000100:00100000:2.0:1787360114.938616:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077056 00000100:00100000:2.0:1787360114.938631:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596075904 00000100:00100000:2.0:1787360114.938633:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596075904 00000100:00100000:2.0:1787360114.938644:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076416 00000100:00100000:2.0:1787360114.938647:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076416 00000100:00100000:2.0:1787360114.938659:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076928 00000100:00100000:2.0:1787360114.938661:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076928 00000100:00100000:2.0:1787360114.938676:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787360114.938685:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596076544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938743:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596076544:12345-0@lo:400:kworker.0 Request processed in 58us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.938750:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787360114.938768:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787360114.938774:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596077056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938798:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596077056:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.938804:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787360114.938813:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787360114.938819:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596075904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938857:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596075904:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.938874:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787360114.938886:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787360114.938892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596076416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938921:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596076416:12345-0@lo:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.938927:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787360114.938940:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787360114.938946:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596076928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.938970:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596076928:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.938976:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1787360114.939000:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360114.939004:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360114.939040:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596075904:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.939051:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596076416:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.939059:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3b9b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596076928:0@lo:400:kworker.0 00010000:00080000:2.0:1787360114.939072:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904190000 x1874182596076544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360114.939082:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596076544:0@lo:400:kworker.0 00010000:00080000:2.0:1787360114.939091:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3b9b1500 x1874182596077056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360114.939099:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3b9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596077056:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.939754:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596075776:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.939811:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.939868:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596076288:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.939895:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.939914:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596076800:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.939937:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.940118:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596077312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.940143:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.940171:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787360114.940178:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596076160:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.940205:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.940275:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596076672:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.940298:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.940384:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596077184:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.940410:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360114.940447:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076800 00000100:00100000:0.0:1787360114.940457:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076800 00000100:00100000:3.0:1787360114.941923:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596077568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360114.942168:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077312 00000100:00100000:0.0:1787360114.942177:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077312 00000100:00100000:0.0:1787360114.942241:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076672 00000100:00100000:0.0:1787360114.942246:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076672 00000100:00100000:0.0:1787360114.942265:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077184 00000100:00100000:0.0:1787360114.942268:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077184 00000100:00100000:0.0:1787360114.942285:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787360114.942296:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596076800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.942737:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596075776 00000100:00100000:2.0:1787360114.942760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596075776 00000100:00100000:2.0:1787360114.942800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787360114.942808:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360114.942903:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596077440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360114.943076:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596075776:12345-0@lo:400:kworker.0 Request processed in 267us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1787360114.943135:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076032 00000100:00100000:2.0:1787360114.943139:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076032 00000100:00100000:2.0:1787360114.943167:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076288 00000100:00100000:2.0:1787360114.943171:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076288 00000100:00100000:2.0:1787360114.943187:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787360114.943194:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596076032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943255:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596076032:12345-0@lo:400:kworker.0 Request processed in 62us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943261:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787360114.943274:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787360114.943280:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596076288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943312:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596076288:12345-0@lo:400:kworker.0 Request processed in 32us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943330:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787360114.943374:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596076160 00000100:00100000:2.0:1787360114.943378:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596076160 00000100:00100000:2.0:1787360114.943404:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787360114.943411:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596076160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943444:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596076160:12345-0@lo:400:kworker.0 Request processed in 34us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943450:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1787360114.943518:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787360114.943528:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596077312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943563:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596077312:12345-0@lo:400:kworker.0 Request processed in 37us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943568:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787360114.943584:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787360114.943590:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596076672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943614:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596076672:12345-0@lo:400:kworker.0 Request processed in 26us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943619:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787360114.943629:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787360114.943635:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596077184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943664:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596077184:12345-0@lo:400:kworker.0 Request processed in 30us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.943669:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787360114.943707:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360114.943712:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360114.943753:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596076160:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943766:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596076672:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943777:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596077184:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943787:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596075776:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943798:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596076288:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.943810:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596077312:0@lo:400:kworker.0 00000100:00100000:0.0:1787360114.944022:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596076800:12345-0@lo:400:kworker.0 Request processed in 1726us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360114.944030:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787360114.944189:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596076800:0@lo:400:kworker.0 00000100:00100000:1.0:1787360114.951347:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360114.954908:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077440 00000100:00100000:2.0:1787360114.954928:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077440 00000100:00100000:2.0:1787360114.955038:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787360114.955051:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596077440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360114.955092:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360114.955209:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596077440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (3873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.955217:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787360114.955533:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596077440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360114.958003:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360114.958107:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596076032:0@lo:400:kworker.0 00000100:00100000:2.0:1787360114.958286:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077568 00000100:00100000:2.0:1787360114.958297:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077568 00000100:00100000:2.0:1787360114.958361:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787360114.958372:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596077568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360114.958403:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360114.958479:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596077568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360114.958487:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787360114.958851:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596077568:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787360115.715552:0:14374:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360115.715562:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360115.715613:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787360115.715621:0:14374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787360115.834280:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360115.863886:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360115.864139:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035520 00000100:00100000:0.0:1787360115.864149:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035520 00000100:00100000:0.0:1787360115.864212:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:0.0:1787360115.864252:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+25:11432:x1874182575035520:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360115.864299:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360115.864320:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720955 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1c8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360115.864425:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee72095c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360115.864439:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee72095c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360115.864450:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee72095c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360115.864460:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787360115.864556:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c8 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360115.864572:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee72095c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c8 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360115.864581:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:0.0:1787360115.864584:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787360115.864588:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef000, rc 0) 00000100:00100000:0.0:1787360115.864660:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:11432:x1874182575035520:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 438us (780us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787360115.864667:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 145 00000100:00100000:1.0:1787360115.871906:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360115.872798:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035648 00000100:00100000:2.0:1787360115.872809:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035648 00000100:00100000:2.0:1787360115.872880:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:2.0:1787360115.872891:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+27:11432:x1874182575035648:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:2.0:1787360115.872949:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.872965:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873000:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873033:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873040:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873047:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873052:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360115.873056:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873064:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873075:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360115.873078:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360115.873083:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.873088:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517400/0x359a4e2aee72096a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360115.873154:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+27:11432:x1874182575035648:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 265us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360115.873161:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:1.0:1787360115.957220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360115.957400:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035776 00000100:00100000:2.0:1787360115.957431:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035776 00000100:00100000:2.0:1787360115.957499:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:2.0:1787360115.957511:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575035776:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:2.0:1787360115.957527:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360115.957548:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee720971 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1cf expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360115.958441:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a88f36f, atime: 0x6a88f36f, ctime: 0x6a88f36f, blocks: 0x8 00010000:00010000:2.0:1787360115.958474:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1787360115.958479:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360115.958490:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee720971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1cf expref: 7 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.958512:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee720971 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1cf expref: 7 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360115.958526:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517400, rc 0) 00000100:00100000:2.0:1787360115.958607:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575035776:12345-192.168.206.11@tcp:101:cat.0 Request processed in 1097us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360115.958616:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:2.0:1787360115.961550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360115.961840:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575035904 00000100:00100000:1.0:1787360115.961849:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575035904 00002000:00100000:1.0:1787360115.961895:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff998904175c00 x1874182575035904/t0(0) o3->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:306/0 lens 488/0 e 0 to 0 dl 1787360126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360115.961906:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904175c00 with x1874182575035904 ext(0->4095) 00002000:00010000:1.0:1787360115.961911:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998904175c00 00000100:00100000:1.0:1787360115.961945:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1787360115.961969:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575035904:12345-192.168.206.11@tcp:3:cat.0 00000100:00100000:3.0:1787360115.962044:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596077696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360115.962196:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360115.962283:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575035904:12345-192.168.206.11@tcp:3:cat.0 Request processed in 313us (738us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787360115.962294:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00002000:00100000:1.0:1787360115.962302:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff998904175c00 x1874182575035904/t0(0) o3->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:306/0 lens 488/4536 e 0 to 0 dl 1787360126 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360115.962311:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904175c00 with x1874182575035904 ext(0->4095) 00002000:00010000:1.0:1787360115.962315:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998904175c00 00000100:00100000:2.0:1787360115.966169:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077696 00000100:00100000:2.0:1787360115.966192:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077696 00000100:00100000:2.0:1787360115.966300:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787360115.966383:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596077696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360115.966434:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787360115.966667:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596077696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 355us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360115.966676:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787360115.966852:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596077696:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1787360116.477895:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1787360116.857688:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787360116.986015:0:8769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395232785064ns, next at 396232780808ns, rc = 0 00000100:00100000:0.0:1787360116.986064:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596077824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360116.986165:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360116.986276:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077824 00000100:00100000:0.0:1787360116.986286:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077824 00000100:00100000:3.0:1787360116.986428:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596077952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360116.986883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360116.987014:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596077952 00000100:00100000:1.0:1787360116.987021:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596077952 00000100:00100000:0.0:1787360116.987124:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787360116.987136:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596077824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360116.987173:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787360116.987255:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596077824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360116.987263:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787360116.987320:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596077824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360116.988637:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787360116.988649:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596077952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787360116.988669:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787360116.988735:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596077952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360116.988742:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787360116.988794:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596077952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787360116.994294:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787360117.309011:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360117.884974:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360118.010993:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360118.011002:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360118.011022:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787360118.011034:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787360118.524129:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787360118.524152:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000004:00080000:3.0:1787360118.525953:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1787360118.526006:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1787360118.526044:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998903478240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787360118.526051:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a0feaee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9989034783c0 00000020:00080000:3.0:1787360118.526054:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a0feaef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998a2efa3200 00000020:00080000:3.0:1787360118.526080:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787360118.526118:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:2.0:1787360118.526222:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360118.526271:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360118.526281:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360118.526290:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360118.526296:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360118.526305:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360118.526320:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787360118.526329:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff998a28ed6a00) 00010000:00010000:2.0:1787360118.526336:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360118.526341:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360118.526348:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee7208ec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360118.526576:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360118.526599:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596078080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787360118.526693:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360118.527086:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078080 00000100:00100000:0.0:1787360118.527098:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078080 00000100:00100000:0.0:1787360118.527263:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787360118.527279:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596078080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787360118.527428:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787360118.527432:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787360111 -> 1787360111 00002000:00010000:0.0:1787360118.527435:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1787360111 -> 1787360111 00002000:00010000:0.0:1787360118.527437:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787360111 -> 1787360111 00002000:00010000:0.0:1787360118.527440:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787360118.527543:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596078080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 269us (849us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787360118.527552:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360118.527599:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787360118.527609:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99890434c700, transno 4294967310 00000004:00080000:2.0:1787360118.527630:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787360118.527661:0:3658:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff998903881880 x1874182596078080/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787360134 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787360118.527675:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998903881880/2, rc 0, transno 4294967313 00000100:00100000:2.0:1787360118.527682:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596078080:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787360118.541284:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787360118.911984:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360119.033646:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360119.033667:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596078208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360119.033739:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360119.033893:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078208 00000100:00100000:2.0:1787360119.033901:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078208 00000100:00100000:2.0:1787360119.033958:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787360119.033977:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596078208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360119.034017:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360119.034066:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596078208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360119.034074:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787360119.034117:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596078208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360119.659772:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659892:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360119.659982:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036288 00000100:00100000:0.0:1787360119.659990:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036288 00000100:00100000:0.0:1787360119.660042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036800 00000100:00100000:0.0:1787360119.660045:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036800 00000100:00100000:0.0:1787360119.660058:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036160 00000100:00100000:0.0:1787360119.660061:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036160 00000100:00100000:0.0:1787360119.660074:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036672 00000100:00100000:0.0:1787360119.660076:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036672 00000100:00100000:0.0:1787360119.660092:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 309 00000100:00100000:0.0:1787360119.660100:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182575036288:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360119.660166:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182575036288:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 66us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360119.660174:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 309 00000100:00100000:0.0:1787360119.660193:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 310 00000100:00100000:0.0:1787360119.660199:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575036800:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360119.660222:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575036800:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360119.660228:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 310 00000100:00100000:0.0:1787360119.660292:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 311 00000100:00100000:0.0:1787360119.660299:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+13:2402:x1874182575036160:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360119.660324:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+13:2402:x1874182575036160:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360119.660330:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 311 00000100:00100000:0.0:1787360119.660342:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 312 00000100:00100000:0.0:1787360119.660349:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575036672:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360119.660368:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575036672:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360119.660375:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 312 00000100:00100000:3.0:1787360119.660499:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036032 00000100:00100000:3.0:1787360119.660504:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036032 00000100:00100000:3.0:1787360119.660539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 387 00000100:00100000:3.0:1787360119.660554:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182575036032:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360119.660580:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2402:x1874182575036032:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360119.660586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 387 00000100:00100000:1.0:1787360119.660861:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036544 00000100:00100000:1.0:1787360119.660866:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036544 00000100:00100000:1.0:1787360119.660899:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036416 00000100:00100000:1.0:1787360119.660903:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036416 00000100:00100000:1.0:1787360119.660925:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1787360119.660932:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182575036544:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360119.660963:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2402:x1874182575036544:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 32us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360119.660983:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:1.0:1787360119.661002:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:1.0:1787360119.661009:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182575036416:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360119.661035:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2402:x1874182575036416:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360119.661042:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00080000:2.0:1787360119.663121:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360119.663129:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360119.663133:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360119.663136:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787360119.930835:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360120.057506:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596078336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.057568:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596078464:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.057598:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.057628:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360120.057655:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596078848:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.057684:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360120.057704:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596079360:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.057729:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360120.057746:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596079872:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.057769:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360120.057794:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787360120.057965:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596078720:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.058010:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596078592:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.058023:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078848 00000100:00100000:1.0:1787360120.058033:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078848 00000100:00100000:0.0:1787360120.058039:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360120.058062:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596079104:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.058085:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078592 00000100:00100000:1.0:1787360120.058090:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078592 00000100:00100000:0.0:1787360120.058109:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079360 00000100:00100000:1.0:1787360120.058114:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787360120.058114:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079360 00000100:00100000:1.0:1787360120.058130:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596078848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.058159:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079872 00000100:00100000:0.0:1787360120.058163:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079872 00000100:00100000:0.0:1787360120.058191:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787360120.058200:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1874182596079360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.058209:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596078848:12345-0@lo:400:kworker.0 Request processed in 82us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.058218:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787360120.058261:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787360120.058266:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1874182596079360:12345-0@lo:400:kworker.0 Request processed in 67us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.058271:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596078592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.058279:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787360120.058298:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787360120.058306:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596079872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.058314:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596078592:12345-0@lo:400:kworker.0 Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.058322:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787360120.058345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078336 00000100:00100000:0.0:1787360120.058345:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596079872:12345-0@lo:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.058350:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078336 00000100:00100000:0.0:1787360120.058356:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787360120.058384:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00080000:0.0:1787360120.058391:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360120.058392:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596078336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787360120.058398:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360120.058429:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596078336:12345-0@lo:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.058444:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787360120.059809:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596078976:0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.059867:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.059887:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596079488:0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.059909:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.059937:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360120.059963:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.059984:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360120.059990:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596080128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360120.060013:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.060051:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078464 00000100:00100000:2.0:1787360120.060058:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078464 00000100:00100000:2.0:1787360120.060119:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078976 00000100:00100000:2.0:1787360120.060123:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078976 00000100:00100000:2.0:1787360120.060150:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079488 00000100:00100000:2.0:1787360120.060152:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079488 00000100:00100000:2.0:1787360120.060169:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787360120.060178:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596078464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.060261:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596078464:12345-0@lo:400:kworker.0 Request processed in 83us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.060269:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787360120.060338:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596078464:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.061554:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787360120.061578:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596078976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.061656:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787360120.061661:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596078976:12345-0@lo:400:kworker.0 Request processed in 92us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.061672:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596079488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.061673:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787360120.061720:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596079488:12345-0@lo:400:kworker.0 Request processed in 53us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.061728:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:0.0:1787360120.061729:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360120.061749:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360120.061866:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596078976:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.061886:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596079488:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.062264:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596079616:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.062324:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.067355:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079104 00000100:00100000:2.0:1787360120.067375:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079104 00000100:00100000:2.0:1787360120.067660:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787360120.067678:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596079104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360120.067818:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596079104:12345-0@lo:400:kworker.0 Request processed in 147us (6068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.067826:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787360120.067862:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080000 00000100:00100000:2.0:1787360120.067866:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080000 00000100:00080000:1.0:1787360120.067900:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360120.067906:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360120.068103:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080128 00000100:00100000:2.0:1787360120.068108:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080128 00000100:00100000:2.0:1787360120.068126:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787360120.068132:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596080000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360120.068161:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360120.068210:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596080000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (8245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.068217:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787360120.068249:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787360120.068255:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596080128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360120.068265:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360120.068291:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596080128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (8278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360120.068297:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787360120.068382:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787360120.068390:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1787360120.068419:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998903b85500, transno 4294967305 00000100:00100000:2.0:1787360120.068439:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596080128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360120.068496:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596080000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360120.071366:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079616 00000100:00100000:2.0:1787360120.071389:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079616 00000100:00100000:1.0:1787360120.071573:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.071608:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787360120.071623:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596079616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071627:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596079232:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071701:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360120.071714:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596079616:12345-0@lo:400:kworker.0 Request processed in 93us (9387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.071731:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596079744:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071766:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360120.071820:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596078336:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071845:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596078848:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071868:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596079360:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071882:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596079872:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.071925:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079232 00000100:00100000:1.0:1787360120.071929:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079232 00000100:00100000:1.0:1787360120.071964:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596079744 00000100:00100000:1.0:1787360120.071967:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596079744 00000100:00100000:1.0:1787360120.071988:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787360120.071994:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596079232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.072034:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596079232:12345-0@lo:400:kworker.0 Request processed in 40us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.072061:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787360120.072082:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787360120.072088:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.072117:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596079744:12345-0@lo:400:kworker.0 Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360120.072122:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787360120.072157:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596079232:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.072166:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596079744:0@lo:400:kworker.0 00000100:00100000:3.0:1787360120.072880:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596078720 00000100:00100000:3.0:1787360120.072985:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596078720 00000100:00100000:3.0:1787360120.073040:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787360120.073049:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596078720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360120.073105:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1874182596078720:12345-0@lo:400:kworker.0 Request processed in 58us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360120.073113:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:3.0:1787360120.073416:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360120.073423:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360120.074216:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00080000:0.0:1787360120.074930:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3ff45500 x1874182596079616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360120.074976:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596079616:0@lo:400:kworker.0 00000100:00100000:0.0:1787360120.075593:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596078592:0@lo:400:kworker.0 00010000:00080000:0.0:1787360120.075611:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989042b0700 x1874182596079104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360120.075621:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596079104:0@lo:400:kworker.0 00000100:00100000:1.0:1787360120.075651:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3661:1874182596078720:0@lo:400:kworker.0 00010000:00010000:1.0:1787360120.953526:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360120.970641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360120.975038:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575036928 00000100:00100000:3.0:1787360120.975061:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575036928 00000100:00100000:3.0:1787360120.975270:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:3.0:1787360120.975380:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+13:11077:x1874182575036928:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787360120.975552:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+13:11077:x1874182575036928:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 270us (4924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360120.975561:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:1.0:1787360120.990334:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360120.991814:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037056 00000100:00100000:3.0:1787360120.991834:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037056 00000100:00100000:3.0:1787360120.991922:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:3.0:1787360120.991935:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:11077:x1874182575037056:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787360120.992095:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:11077:x1874182575037056:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 161us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360120.992126:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:0.0:1787360121.001689:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360121.003467:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037312 00000100:00100000:1.0:1787360121.003484:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037312 00000100:00100000:1.0:1787360121.003597:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1787360121.003612:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+13:11077:x1874182575037312:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787360121.003937:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:11077:x1874182575037312:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 329us (2262us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787360121.003947:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00080000:3.0:1787360121.009295:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360121.081689:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596080256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360121.081807:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360121.082073:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080256 00000100:00100000:2.0:1787360121.082083:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080256 00000100:00100000:2.0:1787360121.082150:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787360121.082162:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596080256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360121.082205:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787360121.082292:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596080256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360121.082300:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787360121.082397:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596080256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360121.224147:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360121.224410:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037440 00000100:00100000:2.0:1787360121.224423:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037440 00000100:00100000:2.0:1787360121.224632:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00100000:2.0:1787360121.224645:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:11892:x1874182575037440:12345-192.168.206.11@tcp:101:lsof.0 00010000:00010000:2.0:1787360121.224670:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360121.224696:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1d6 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.224782:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.224836:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.224849:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360121.225090:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787360121.225096:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360121.225150:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.225182:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee720978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 7 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.225205:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 6 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360121.225215:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:2.0:1787360121.225218:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360121.225345:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:2.0:1787360121.225431:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:11892:x1874182575037440:12345-192.168.206.11@tcp:101:lsof.0 Request processed in 788us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360121.225506:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 149 00000100:00080000:3.0:1787360121.228836:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787360121.981644:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360122.106126:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596080384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360122.106247:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360122.106503:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080384 00000100:00100000:3.0:1787360122.106516:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080384 00000100:00100000:3.0:1787360122.106597:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787360122.106610:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596080384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360122.106646:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787360122.106702:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596080384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360122.106709:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1787360122.106963:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360122.107028:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596080384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360122.107969:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360122.107989:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596080512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360122.108065:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360122.108272:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080512 00000100:00100000:3.0:1787360122.108281:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080512 00000100:00100000:3.0:1787360122.108357:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787360122.108368:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596080512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360122.108394:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787360122.108442:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596080512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360122.108449:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1787360122.108517:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360122.108586:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596080512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787360123.002435:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360124.025396:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360124.154843:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360124.154874:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596080640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360124.155252:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360124.155380:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080640 00000100:00100000:3.0:1787360124.155390:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080640 00000100:00100000:3.0:1787360124.155464:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787360124.155476:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596080640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360124.155521:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360124.155587:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596080640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360124.155595:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787360124.155818:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596080640:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1787360124.667447:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1787360124.673620:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787360124.673649:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787360124.673737:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787360124.673750:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787360124.781187:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781362:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781404:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360124.781452:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038080 00000100:00100000:0.0:1787360124.781464:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038080 00000100:00100000:0.0:1787360124.781533:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037952 00000100:00100000:0.0:1787360124.781537:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037952 00000100:00100000:0.0:1787360124.781564:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:0.0:1787360124.781577:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575038080:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.781669:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575038080:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 95us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.781677:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:0.0:1787360124.781697:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:0.0:1787360124.781704:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575037952:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.781731:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575037952:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.781738:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:0.0:1787360124.781761:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037824 00000100:00100000:0.0:1787360124.781765:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037824 00000100:00100000:0.0:1787360124.781810:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038336 00000100:00100000:0.0:1787360124.781813:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038336 00000100:00100000:0.0:1787360124.781828:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037696 00000100:00100000:0.0:1787360124.781830:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037696 00000100:00100000:0.0:1787360124.781844:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038208 00000100:00100000:0.0:1787360124.781847:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038208 00000100:00100000:0.0:1787360124.781868:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:0.0:1787360124.781874:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575037824:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.781907:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575037824:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.781923:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 319 00000100:00100000:0.0:1787360124.781936:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:0.0:1787360124.781942:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575038336:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.781972:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575038336:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.781978:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 320 00000100:00100000:0.0:1787360124.781990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:0.0:1787360124.781996:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+13:2400:x1874182575037696:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.782023:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+13:2400:x1874182575037696:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.782030:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 321 00000100:00100000:0.0:1787360124.782041:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 322 00000100:00100000:0.0:1787360124.782047:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575038208:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360124.782072:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575038208:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360124.782078:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 322 00000100:00080000:0.0:1787360124.782110:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360124.782116:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360124.782119:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360124.782121:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360124.782610:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575037568 00000100:00100000:1.0:1787360124.782618:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575037568 00000100:00100000:1.0:1787360124.782663:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 389 00000100:00100000:1.0:1787360124.782673:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575037568:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360124.782717:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bab4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575037568:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 46us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360124.782724:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 389 00000001:02000400:0.0:1787360124.872755:0:14572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:55:23 (1787360123) 00010000:00010000:2.0:1787360125.056092:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360125.178746:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596080768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360125.178856:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.178923:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596081024:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.178963:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596081280:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.178966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.178997:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596081536:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179004:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179030:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360125.179032:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596081792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.179058:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596082048:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179067:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179089:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360125.179093:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596082304:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.179118:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787360125.179123:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179127:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596081152:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179150:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787360125.179159:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596080896:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.179166:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179192:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596081664:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179204:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179222:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179270:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890409a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596082176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.179293:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360125.179332:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081024 00000100:00100000:1.0:1787360125.179340:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081024 00000100:00100000:1.0:1787360125.179384:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081280 00000100:00100000:1.0:1787360125.179394:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081280 00000100:00100000:1.0:1787360125.179410:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081536 00000100:00100000:1.0:1787360125.179412:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081536 00000100:00100000:0.0:1787360125.179474:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596081408:0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179507:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360125.179540:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596081920:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.179546:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081152 00000100:00100000:2.0:1787360125.179559:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081152 00000100:00100000:0.0:1787360125.179566:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360125.179586:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596082432:0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.179610:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082048 00000100:00100000:1.0:1787360125.179615:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082048 00000100:00100000:0.0:1787360125.179626:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360125.179656:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081792 00000100:00100000:0.0:1787360125.179661:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081792 00000100:00100000:0.0:1787360125.179688:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082304 00000100:00100000:0.0:1787360125.179691:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082304 00000100:00100000:0.0:1787360125.179704:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081920 00000100:00100000:0.0:1787360125.179706:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081920 00000100:00100000:0.0:1787360125.179720:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082432 00000100:00100000:0.0:1787360125.179723:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082432 00000100:00100000:0.0:1787360125.179740:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787360125.179749:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596081792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179819:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596081792:12345-0@lo:400:kworker.0 Request processed in 70us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360125.179835:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787360125.179853:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787360125.179859:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596082304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.179891:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596082304:12345-0@lo:400:kworker.0 Request processed in 32us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360125.179896:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787360125.179906:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787360125.179913:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596081920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.180501:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596081920:12345-0@lo:400:kworker.0 Request processed in 585us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360125.180511:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787360125.180691:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787360125.180702:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596082432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.180746:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596082432:12345-0@lo:400:kworker.0 Request processed in 48us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360125.180752:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787360125.180790:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081664 00000100:00100000:0.0:1787360125.180802:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081664 00000100:00100000:0.0:1787360125.180833:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082176 00000100:00100000:0.0:1787360125.180837:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082176 00000100:00100000:0.0:1787360125.180853:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787360125.180984:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787360125.182437:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596081408 00000100:00100000:2.0:1787360125.182454:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596081408 00000100:00100000:2.0:1787360125.182479:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787360125.182491:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596081152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.182618:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596081152:12345-0@lo:400:kworker.0 Request processed in 130us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.182626:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787360125.182644:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787360125.182651:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596081408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.182683:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596081408:12345-0@lo:400:kworker.0 Request processed in 34us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.182688:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787360125.182715:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360125.182734:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596082560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360125.182822:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360125.182933:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596081152:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.182978:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080768 00000100:00100000:2.0:1787360125.182982:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080768 00000100:00100000:2.0:1787360125.183018:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082560 00000100:00100000:2.0:1787360125.183021:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082560 00000100:00100000:2.0:1787360125.183035:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787360125.183040:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596080768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360125.183067:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360125.183104:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596080768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183111:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787360125.183131:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787360125.183137:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2f19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596082560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360125.183146:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360125.183176:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2f19bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596082560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183182:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787360125.183469:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596082560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787360125.183523:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360125.183530:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360125.183533:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360125.183536:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360125.183553:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596080896 00000100:00100000:2.0:1787360125.183557:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596080896 00000100:00100000:2.0:1787360125.183590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787360125.183597:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596080896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.183633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596080896:12345-0@lo:400:kworker.0 Request processed in 37us (4431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183640:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1787360125.183690:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787360125.183701:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596081536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.183742:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596081536:12345-0@lo:400:kworker.0 Request processed in 44us (4712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183748:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1787360125.183767:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787360125.183788:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596081664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.183821:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596081664:12345-0@lo:400:kworker.0 Request processed in 48us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183836:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1787360125.183850:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1787360125.183857:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596082176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.183889:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596082176:12345-0@lo:400:kworker.0 Request processed in 33us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360125.183894:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00080000:2.0:1787360125.183931:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989042b2d80 x1874182596081664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360125.183943:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596081664:0@lo:400:kworker.0 00010000:00080000:2.0:1787360125.183956:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890409a300 x1874182596082176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360125.183964:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890409a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596082176:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.183978:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596081536:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184029:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596080896:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184042:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596081408:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184053:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787360125.184058:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998903881880, transno 4294967313 00000100:00100000:2.0:1787360125.184071:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596081920:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184083:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596082432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184096:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596081792:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184107:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890409bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596082304:0@lo:400:kworker.0 00000100:00100000:2.0:1787360125.184132:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596080768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360125.184545:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787360125.184555:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596082048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360125.184608:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596082048:12345-0@lo:400:kworker.0 Request processed in 55us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360125.184614:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787360125.184649:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596082048:0@lo:400:kworker.0 00000100:00080000:2.0:1787360125.184729:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360125.186335:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596081024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360125.186438:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596081024:12345-0@lo:400:kworker.0 Request processed in 5577us (7472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360125.186449:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787360125.186566:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596081024:0@lo:400:kworker.0 00000100:00100000:3.0:1787360125.186669:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596081280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360125.186728:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596081280:12345-0@lo:400:kworker.0 Request processed in 5735us (7724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360125.186735:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1787360125.186846:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596081280:0@lo:400:kworker.0 00010000:00010000:0.0:1787360126.076588:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360126.170530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360126.170614:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038592 00000100:00100000:2.0:1787360126.170624:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038592 00000100:00100000:2.0:1787360126.170703:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00100000:2.0:1787360126.170714:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+13:12160:x1874182575038592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360126.170741:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360126.170761:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720986 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1dd expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170836:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170850:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170861:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170877:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170885:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170891:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.170997:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72099b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171006:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72099b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171013:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72099b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360126.171023:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787360126.171096:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171103:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171109:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171115:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360126.171120:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171127:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171139:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998902719e00) 00010000:00010000:2.0:1787360126.171141:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360126.171145:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171161:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517000/0x359a4e2aee72098d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171176:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171183:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171189:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171193:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360126.171197:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171203:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171210:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff998a227ad500) 00010000:00010000:2.0:1787360126.171212:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360126.171214:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171220:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040400/0x359a4e2aee720994 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171529:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516600/0x359a4e2aee720986 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1dd expref: 16 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171557:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72099b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1dd expref: 15 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360126.171563:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:2.0:1787360126.171566:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360126.171569:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040600, rc 0) 00000100:00100000:2.0:1787360126.171623:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+15:12160:x1874182575038592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 911us (1102us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787360126.171631:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 150 00000100:00080000:0.0:1787360126.172075:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360126.176932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360126.177020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360126.177153:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038848 00000100:00100000:2.0:1787360126.177163:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038848 00000100:00100000:2.0:1787360126.177248:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:2.0:1787360126.177270:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:12160:x1874182575038848:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787360126.177366:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+15:12160:x1874182575038848:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360126.177375:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 151 00000100:00100000:3.0:1787360126.178079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038720 00000100:00100000:3.0:1787360126.178086:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038720 00000100:00100000:3.0:1787360126.178133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360126.178141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+15:2399:x1874182575038720:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360126.178152:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360126.178173:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72099b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1dd expref: 15 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360126.178190:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360126.178195:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360126.178542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+14:2399:x1874182575038720:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 400us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360126.178551:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:0.0:1787360126.185120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360126.186985:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575038976 00000100:00100000:3.0:1787360126.186998:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575038976 00000100:00100000:3.0:1787360126.187111:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00100000:3.0:1787360126.187124:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:12160:x1874182575038976:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787360126.187267:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:12160:x1874182575038976:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 137us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360126.187276:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 152 00000100:00080000:0.0:1787360126.187659:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:2.0:1787360126.201910:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360126.201920:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360126.203604:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787360126.203620:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787360126.210189:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360126.210216:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596082688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360126.210317:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360126.212941:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082688 00000100:00100000:2.0:1787360126.212956:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082688 00000100:00100000:2.0:1787360126.216887:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787360126.216901:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596082688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360126.216939:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787360126.217454:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596082688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 553us (7135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360126.217461:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787360126.221451:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fedd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596082688:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787360126.523738:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360127.097470:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360127.229169:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360127.229200:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596082816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360127.229344:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360127.229415:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082816 00000100:00100000:2.0:1787360127.229424:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082816 00000100:00100000:2.0:1787360127.229487:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787360127.229497:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596082816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360127.229531:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787360127.229577:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596082816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360127.229585:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787360127.229639:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596082816:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787360127.229854:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360127.230571:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360127.230589:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596082944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360127.230640:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360127.231118:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596082944 00000100:00100000:2.0:1787360127.231127:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596082944 00000100:00100000:2.0:1787360127.231186:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787360127.231196:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596082944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360127.231219:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787360127.231292:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596082944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360127.231299:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787360127.231343:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596082944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787360127.232129:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787360127.545873:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787360128.126433:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360128.250951:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360128.250961:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360128.251052:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787360128.251062:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360128.272102:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.272138:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575039104 00000100:00100000:3.0:1787360128.272147:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575039104 00000100:00100000:3.0:1787360128.272206:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 153 00000100:00100000:3.0:1787360128.272217:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:12202:x1874182575039104:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360128.272261:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360128.272281:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1e4 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272340:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272355:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272366:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272381:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272388:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272394:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272447:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272455:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272462:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272468:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.272472:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272479:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272491:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:3.0:1787360128.272494:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.272498:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272504:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272515:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272521:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272527:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272538:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.272542:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272548:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272556:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff998902718b00) 00010000:00010000:3.0:1787360128.272558:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.272561:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272566:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272596:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1e4 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272606:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:3.0:1787360128.272608:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.272612:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1e4 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.272619:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8e00, rc 0) 00000100:00100000:3.0:1787360128.272672:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:12202:x1874182575039104:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 458us (580us total) trans 0 rc 301/301 00000100:00100000:3.0:1787360128.272680:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 153 00000100:00080000:3.0:1787360128.272702:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360128.288712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360128.289543:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575039360 00000100:00100000:0.0:1787360128.289554:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575039360 00000100:00100000:0.0:1787360128.289631:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00100000:0.0:1787360128.289641:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+14:12202:x1874182575039360:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:0.0:1787360128.289688:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360128.289712:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee7202fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef008 expref: 14 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.289729:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:0.0:1787360128.289734:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360128.289798:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.289813:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 5 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.289822:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.289869:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 5 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.289883:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 5 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360128.289897:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3c84f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596083072:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360128.289978:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a07f9d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360128.292595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.292802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575039488 00000100:00100000:3.0:1787360128.292811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575039488 00010000:00010000:3.0:1787360128.292867:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 6 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.292907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1787360128.292917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575039488:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360128.292930:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360128.292937:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 6 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.292950:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 6 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.292971:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:3.0:1787360128.292977:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.292986:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.292993:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.293011:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360128.293059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575039488:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.293066:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00080000:0.0:1787360128.293324:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787360128.293661:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01516000/0x359a4e2aee72097f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1d6 expref: 5 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360128.293678:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3c84f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596083072:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360128.293697:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.293707:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.293713:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.293735:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.293744:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.293753:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294536:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294549:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294556:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360128.294582:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfd25118 reply state 0000000093d4dfae transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294593:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294600:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360128.294603:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360128.294606:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787360128.294610:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787360128.294617:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294623:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294630:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294636:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360128.294641:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294648:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294657:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ece300) 00010000:00010000:2.0:1787360128.294659:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360128.294663:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294680:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee7209be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360128.294697:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfd25118 reply state 0000000093d4dfae transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294707:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.294713:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff998a227ad900) 00010000:00010000:2.0:1787360128.294716:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360128.294718:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787360128.294836:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+15:12202:x1874182575039360:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 5194us (6129us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787360128.294844:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 154 00000100:00100000:1.0:1787360128.405032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.405192:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575039616 00000100:00100000:3.0:1787360128.405214:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575039616 00000100:00100000:3.0:1787360128.405318:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:3.0:1787360128.405328:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+15:12210:x1874182575039616:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:3.0:1787360128.405352:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360128.405376:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1eb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405528:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405556:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405566:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360128.405607:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787360128.405611:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360128.405633:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405658:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1eb expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405706:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1eb expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.405716:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:2.0:1787360128.405719:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360128.405722:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a00031800, rc 0) 00000100:00100000:2.0:1787360128.405791:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+16:12210:x1874182575039616:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 463us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360128.405798:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 155 00000100:00100000:0.0:1787360128.465687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.469009:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575039744 00000100:00100000:3.0:1787360128.469022:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575039744 00000100:00100000:3.0:1787360128.469155:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:3.0:1787360128.469166:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+16:12216:x1874182575039744:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360128.469184:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360128.469203:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1f2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469280:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469294:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469305:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469316:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469322:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469345:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469430:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469438:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.469446:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360128.469489:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787360128.469492:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360128.470875:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470895:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470902:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470909:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470925:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.470929:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470936:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470964:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:3.0:1787360128.470967:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.470971:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470978:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee7209e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470993:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.470999:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471004:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471008:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.471011:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471016:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471022:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff998a227ad900) 00010000:00010000:3.0:1787360128.471024:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.471027:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471032:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee7209ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471071:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee7209e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f2 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471084:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f2 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.471091:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360128.471093:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787360128.471096:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8200, rc 0) 00000100:00100000:3.0:1787360128.471164:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+17:12216:x1874182575039744:12345-192.168.206.11@tcp:101:bash.0 Request processed in 2000us (5485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.471173:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 156 00000100:00100000:3.0:1787360128.479935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.480418:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040000 00000100:00100000:2.0:1787360128.480430:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040000 00000100:00100000:2.0:1787360128.480514:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:2.0:1787360128.480525:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+17:12216:x1874182575040000:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360128.480545:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360128.480564:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030600/0x359a4e2aee7209fd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef1f9 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480665:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480680:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480691:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480740:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480775:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.480783:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360128.481079:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787360128.481205:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481215:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481222:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481617:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481626:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481632:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481638:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a00030400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360128.481643:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481650:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481675:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360128.481678:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360128.481683:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481689:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030400/0x359a4e2aee720a04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360128.481703:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000021a9f2 reply state 000000006bb6d7b6 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481713:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481719:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:2.0:1787360128.481722:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360128.481724:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787360128.481753:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030600/0x359a4e2aee7209fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 20 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481886:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 19 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.481893:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:2.0:1787360128.481896:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360128.481898:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696400, rc 0) 00000100:00100000:2.0:1787360128.482054:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+20:12216:x1874182575040000:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1530us (2132us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787360128.482062:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 157 00000100:00100000:1.0:1787360128.493098:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360128.497620:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040128 00000100:00100000:0.0:1787360128.497633:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040128 00000100:00100000:0.0:1787360128.497785:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1787360128.497796:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2400:x1874182575040128:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360128.497812:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360128.497833:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef200 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360128.497858:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787360128.497879:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1787360128.497883:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360128.497893:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.497913:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.498702:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:0.0:1787360128.498827:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575040128:12345-192.168.206.11@tcp:101:bash.0 Request processed in 1031us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360128.498835:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00080000:3.0:1787360128.501060:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360128.505344:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.505535:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040256 00000100:00100000:2.0:1787360128.505544:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040256 00000100:00100000:2.0:1787360128.505599:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1787360128.505609:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:12216:x1874182575040256:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360128.505626:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360128.505642:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef207 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.505672:0:8770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.505681:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360128.505685:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360128.505691:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.505722:0:8770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.505735:0:8770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360128.505749:0:8770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1874182596083200:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360128.505919:0:8770:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360128.512611:0:8770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8770:1874182596083200:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360128.512647:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 7 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.512683:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787360128.512799:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:12216:x1874182575040256:12345-192.168.206.11@tcp:101:bash.0 Request processed in 7189us (7461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360128.512806:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1787360128.519666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.519779:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040384 00000100:00100000:2.0:1787360128.519788:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040384 00010000:00010000:2.0:1787360128.519838:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360128.519875:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:2.0:1787360128.519886:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575040384:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360128.519899:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360128.519919:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.519932:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.519955:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3bab57d/0x359a4e2aee720a20 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef200 expref: 7 pid: 8448 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.519971:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360128.519976:0:7474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360128.519984:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.520009:0:7474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.520049:0:7474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360128.520063:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1874182596083328:192.168.206.11@tcp:105: 00000100:00100000:2.0:1787360128.520127:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a2bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360128.535745:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.535888:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7474:1874182596083328:192.168.206.11@tcp:105: 00010000:00010000:2.0:1787360128.535916:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360128.535978:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575040384:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 16092us (16320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360128.535994:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 82 00000100:00100000:3.0:1787360128.536076:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040640 00000100:00100000:3.0:1787360128.536084:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040640 00000100:00100000:3.0:1787360128.536135:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1787360128.536144:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:12216:x1874182575040640:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:3.0:1787360128.536464:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+21:12216:x1874182575040640:12345-192.168.206.11@tcp:35:bash.0 Request processed in 320us (727us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787360128.536471:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:1.0:1787360128.605332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.605542:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575040896 00000100:00100000:2.0:1787360128.605551:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575040896 00000100:00100000:2.0:1787360128.605651:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:2.0:1787360128.605662:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:12226:x1874182575040896:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360128.605687:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360128.605706:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef20e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360128.605806:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787360128.605906:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720a2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef20e expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.606052:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:2.0:1787360128.606055:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360128.606061:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef20e expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.606076:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697a00, rc 0) 00000100:00100000:2.0:1787360128.606137:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:12226:x1874182575040896:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 477us (911us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1787360128.606145:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 158 00000100:00100000:1.0:1787360128.611369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.611496:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575041152 00000100:00100000:3.0:1787360128.611505:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575041152 00000100:00100000:3.0:1787360128.611550:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:3.0:1787360128.611560:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+22:12226:x1874182575041152:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360128.611799:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:12226:x1874182575041152:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 239us (438us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787360128.611807:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:1.0:1787360128.692960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.693100:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575041280 00000100:00100000:3.0:1787360128.693109:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575041280 00000100:00100000:3.0:1787360128.693164:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:3.0:1787360128.693175:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:12232:x1874182575041280:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360128.693197:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360128.693215:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef215 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693329:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693345:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693357:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360128.693396:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787360128.693399:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360128.693416:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693439:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef215 expref: 25 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693457:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef215 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.693480:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360128.693483:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360128.693486:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8e00, rc 0) 00000100:00100000:3.0:1787360128.693549:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+24:12232:x1874182575041280:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 375us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.693556:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:2.0:1787360128.696875:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360128.697077:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575041536 00000100:00100000:0.0:1787360128.697091:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575041536 00000100:00100000:0.0:1787360128.697168:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1787360128.697179:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+24:12232:x1874182575041536:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360128.697199:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360128.697222:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720a4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef21c expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.700656:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.700677:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.700689:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360128.700700:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787360128.700830:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720a4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef21c expref: 27 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.700851:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef21c expref: 26 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.700860:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:1.0:1787360128.700863:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360128.700867:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:1.0:1787360128.701003:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+26:12232:x1874182575041536:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 3825us (4140us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787360128.701013:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1787360128.708687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.708838:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575041792 00000100:00100000:2.0:1787360128.708847:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575041792 00000100:00100000:2.0:1787360128.708905:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:2.0:1787360128.708922:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+26:12232:x1874182575041792:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:2.0:1787360128.709051:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360128.709078:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720a5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef223 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.709177:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.709191:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.709202:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360128.709353:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787360128.709553:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720a5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef223 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.709572:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef223 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.709582:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:2.0:1787360128.709586:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787360128.709589:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697200, rc 0) 00000100:00100000:2.0:1787360128.709700:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+28:12232:x1874182575041792:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 784us (1021us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787360128.709708:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:0.0:1787360128.717319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.717505:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575041920 00000100:00100000:3.0:1787360128.717515:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575041920 00000100:00100000:3.0:1787360128.717576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1787360128.717586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+28:2401:x1874182575041920:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360128.717600:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360128.717625:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee720a51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef21c expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.717642:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:3.0:1787360128.717647:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360128.717702:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+27:2401:x1874182575041920:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 117us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.717711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:0.0:1787360128.729095:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.730713:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042048 00000100:00100000:2.0:1787360128.730726:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042048 00000100:00100000:2.0:1787360128.730859:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787360128.730871:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+6:2400:x1874182575042048:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:2.0:1787360128.731795:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.731817:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.731835:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360128.731840:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360128.731845:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.731896:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.731911:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 6 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360128.731933:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596083456:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360128.732563:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106d3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360128.734274:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1874182596083456:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360128.734299:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360128.734725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360128.734911:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042176 00000100:00100000:2.0:1787360128.734926:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042176 00002000:00100000:2.0:1787360128.735069:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9989039d3b80 x1874182575042176/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:319/0 lens 504/0 e 0 to 0 dl 1787360139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360128.735078:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989039d3b80 with x1874182575042176 ext(0->12) 00010000:00010000:2.0:1787360128.735085:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 7 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.735098:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 7 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360128.735104:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9989039d3b80 00000100:00100000:2.0:1787360128.735150:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1787360128.735159:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575042176:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:2.0:1787360128.736211:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989039d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575042176:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 1049us (1483us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787360128.736220:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00002000:00100000:2.0:1787360128.736251:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9989039d3b80 x1874182575042176/t4294967306(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:319/0 lens 504/448 e 0 to 0 dl 1787360139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360128.736260:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989039d3b80 with x1874182575042176 ext(0->12) 00010000:00010000:2.0:1787360128.736267:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360128.736279:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360128.736286:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9989039d3b80 00000100:00100000:0.0:1787360128.739371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.739466:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042304 00000100:00100000:3.0:1787360128.739475:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042304 00010000:00010000:3.0:1787360128.739508:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.739544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 83 00000100:00100000:3.0:1787360128.739563:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+9:2402:x1874182575042304:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360128.739577:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787360128.739595:0:6518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787360128.739598:0:6518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787360128 00002000:00010000:3.0:1787360128.739600:0:6518:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787360128 00002000:00010000:3.0:1787360128.739603:0:6518:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787360128 00002000:00010000:3.0:1787360128.739604:0:6518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787360128.739610:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.739624:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.739645:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720a27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef207 expref: 9 pid: 8770 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.739662:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360128.739667:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360128.739672:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.739682:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.739717:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360128.739773:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2402:x1874182575042304:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 211us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.739789:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 83 00010000:00010000:0.0:1787360128.740203:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740213:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740274:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740282:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740290:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740297:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360128.740301:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740309:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740322:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.740329:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040e5b0d2/0x359a4e2aee720a74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360128.740386:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575042048:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 9517us (11300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360128.740394:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1787360128.746558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.747331:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042560 00000100:00100000:3.0:1787360128.747342:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042560 00000100:00100000:3.0:1787360128.747396:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:3.0:1787360128.747407:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20566050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+27:12232:x1874182575042560:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:3.0:1787360128.747473:0:6534:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef223 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360128.747696:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1787360128.747725:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787360128.749296:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1787360128.749349:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.749367:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 31 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.749376:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.749413:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 31 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.749428:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 31 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.749441:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874182596083584:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360128.749516:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a32300 going to sleep for 11 seconds 00000100:00100000:2.0:1787360128.757023:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360128.757490:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042688 00000100:00100000:0.0:1787360128.757508:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042688 00010000:00010000:0.0:1787360128.757567:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 32 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.757602:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6534:1874182596083584:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360128.757630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 84 00010000:00010000:3.0:1787360128.757644:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360128.757645:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:2400:x1874182575042688:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360128.757683:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360128.757695:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 32 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757711:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 32 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757739:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720a12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f9 expref: 32 pid: 9449 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757768:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:0.0:1787360128.757774:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757784:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757792:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360128.757823:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360128.757916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+31:2400:x1874182575042688:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 274us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360128.757926:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 84 00010000:00010000:3.0:1787360128.757943:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.757954:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360128.758061:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1787360128.758182:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787360128.758324:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874182596083712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787360128.758376:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360128.758400:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a32c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360128.758644:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596083712 00000100:00100000:2.0:1787360128.758651:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596083712 00000100:00100000:2.0:1787360128.758727:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787360128.758737:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1874182596083712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787360128.758825:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6534:x1874182596083712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360128.758832:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787360128.758925:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360128.759585:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874182596083712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787360128.760050:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787360128.760117:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874182596083840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787360128.760155:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360128.760720:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360128.767614:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596083840 00000100:00100000:2.0:1787360128.767628:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596083840 00000100:00100000:2.0:1787360128.767699:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787360128.767723:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6534:x1874182596083840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787360128.769060:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6534:x1874182596083840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1334us (8899us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787360128.769071:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787360128.771294:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3fede300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6534:1874182596083840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787360128.771388:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787360128.771439:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771449:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771457:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771475:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.771479:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771486:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771696:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:3.0:1787360128.771707:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787360128.771712:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.771719:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a7b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787360128.771841:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787360128.771900:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787360128.772025:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407018798665ns, next at 408018796202ns, rc = 0 00000001:00080000:3.0:1787360128.772034:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787360128.772058:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a227ad000) 00010000:00010000:3.0:1787360128.772061:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787360128.772068:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720a66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef223 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.772297:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20566050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+34:12232:x1874182575042560:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 24890us (25746us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787360128.772412:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000020:00080000:3.0:1787360128.772420:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787360128.774876:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360128.775578:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575042816 00000100:00100000:1.0:1787360128.775589:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575042816 00000100:00100000:1.0:1787360128.775640:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:1.0:1787360128.775648:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+34:12232:x1874182575042816:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360128.775682:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360128.775702:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720a82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef22a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.775763:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720a82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef22a expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.775777:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720a82 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef22a expref: 35 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.775795:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360128.775797:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360128.775801:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70a00, rc 0) 00000100:00100000:1.0:1787360128.775856:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:12232:x1874182575042816:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 208us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360128.775863:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:1.0:1787360128.779190:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360128.779582:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575043072 00000100:00100000:0.0:1787360128.779592:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575043072 00000100:00100000:0.0:1787360128.779641:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1787360128.779649:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:12232:x1874182575043072:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1787360128.779884:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890409a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+36:12232:x1874182575043072:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 235us (701us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787360128.779893:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:0.0:1787360128.904895:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360128.904961:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575043328 00000100:00100000:1.0:1787360128.904972:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575043328 00000100:00100000:1.0:1787360128.905030:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:1.0:1787360128.905039:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+36:12242:x1874182575043328:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360128.905061:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360128.905081:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef231 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360128.905166:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787360128.905287:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720a89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef231 expref: 38 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.905324:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:1.0:1787360128.905328:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360128.905334:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef231 expref: 38 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.905347:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71400, rc 0) 00000100:00100000:1.0:1787360128.905413:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+37:12242:x1874182575043328:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 374us (526us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1787360128.905420:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:2.0:1787360128.914785:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.914867:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575043456 00000100:00100000:3.0:1787360128.914877:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575043456 00000100:00100000:3.0:1787360128.914947:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:3.0:1787360128.914957:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:12242:x1874182575043456:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:3.0:1787360128.915026:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915044:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915055:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915066:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915074:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915081:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915149:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915158:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915166:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360128.915209:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915263:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915269:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915275:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915281:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.915285:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915293:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915305:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360128.915308:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.915313:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915319:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720a97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915334:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915341:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915347:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915359:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.915362:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915369:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915378:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:3.0:1787360128.915380:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.915383:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915389:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720a9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915412:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915419:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915425:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915431:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.915434:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915440:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915458:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360128.915460:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360128.915463:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.915469:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720aa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.915541:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:12242:x1874182575043456:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 585us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.915549:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:0.0:1787360128.924714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360128.925004:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575043712 00000100:00100000:1.0:1787360128.925014:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575043712 00000100:00100000:1.0:1787360128.925103:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:1.0:1787360128.925114:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:12242:x1874182575043712:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360128.925340:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:12242:x1874182575043712:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 227us (634us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787360128.925348:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1787360128.987083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360128.987184:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575043968 00000100:00100000:1.0:1787360128.987194:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575043968 00000100:00100000:1.0:1787360128.987282:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:1.0:1787360128.987293:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+38:12245:x1874182575043968:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360128.987326:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360128.987347:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef238 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987420:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987446:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987457:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987469:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987477:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987484:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987587:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987597:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987604:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360128.987613:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787360128.987695:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987703:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987710:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987721:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360128.987725:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987748:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987769:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:1.0:1787360128.987772:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360128.987776:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987783:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720ab3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987796:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987803:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987809:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987814:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360128.987817:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987823:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987848:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:1.0:1787360128.987851:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360128.987854:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987860:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987894:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 41 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987908:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 40 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360128.987915:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360128.988023:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360128.988026:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70000, rc 0) 00000100:00100000:1.0:1787360128.988089:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+40:12245:x1874182575043968:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 797us (1014us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787360128.988096:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 165 00000100:00100000:2.0:1787360128.992132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360128.992323:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575044096 00000100:00100000:3.0:1787360128.992333:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575044096 00000100:00100000:3.0:1787360128.992394:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:3.0:1787360128.992561:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+40:12245:x1874182575044096:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:3.0:1787360128.992625:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992641:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992652:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992685:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992692:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992715:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992721:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360128.992726:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992733:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992746:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360128.992749:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360128.992765:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360128.992772:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720acf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360128.992992:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+40:12245:x1874182575044096:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 490us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360128.993001:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:0.0:1787360128.994970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360128.995101:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575044352 00000100:00100000:1.0:1787360128.995110:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575044352 00000100:00100000:1.0:1787360128.995156:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1787360128.995164:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+40:12245:x1874182575044352:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360128.995562:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+41:12245:x1874182575044352:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 396us (656us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787360128.995570:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00010000:00010000:0.0:1787360129.146011:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360129.273531:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596083968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360129.273603:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360129.273917:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596083968 00000100:00100000:0.0:1787360129.273925:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596083968 00000100:00100000:0.0:1787360129.274019:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787360129.274029:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596083968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360129.274061:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360129.274117:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596083968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360129.274126:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787360129.274204:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596083968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360129.279897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.280008:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575044608 00000100:00100000:2.0:1787360129.280019:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575044608 00000100:00100000:2.0:1787360129.280085:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 167 00000100:00100000:2.0:1787360129.280095:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+41:12276:x1874182575044608:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:2.0:1787360129.280117:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360129.280136:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720ad6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef23f expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.280345:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720add lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.280360:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.280372:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720add lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360129.280383:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787360129.280494:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720ad6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef23f expref: 44 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.280512:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720add lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef23f expref: 43 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.280534:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:2.0:1787360129.280537:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360129.280540:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697000, rc 0) 00000100:00100000:2.0:1787360129.280592:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+43:12276:x1874182575044608:12345-192.168.206.11@tcp:101:cat.0 Request processed in 499us (705us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787360129.280599:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 167 00000100:00100000:2.0:1787360129.286265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360129.286362:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575044864 00000100:00100000:3.0:1787360129.286371:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575044864 00000100:00100000:3.0:1787360129.286427:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1787360129.286437:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+43:12276:x1874182575044864:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:3.0:1787360129.286670:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+44:12276:x1874182575044864:12345-192.168.206.11@tcp:35:cat.0 Request processed in 234us (414us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1787360129.286695:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:3.0:1787360129.287660:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.294019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575044992 00000100:00100000:2.0:1787360129.294034:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575044992 00000100:00100000:2.0:1787360129.294118:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360129.294129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+44:2399:x1874182575044992:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360129.294143:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360129.294166:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720add lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef23f expref: 44 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.294186:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:2.0:1787360129.294191:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360129.294464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+43:2399:x1874182575044992:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 335us (6805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360129.294472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1787360129.344483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.344599:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575045248 00000100:00100000:2.0:1787360129.344609:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575045248 00000100:00100000:2.0:1787360129.344709:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:2.0:1787360129.344729:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+43:12282:x1874182575045248:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1787360129.344761:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360129.344777:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787360129.344803:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8e00/0x359a4e2aee720a43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef215 expref: 43 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.344820:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360129.344835:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360129.344848:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720aeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef246 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.344941:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.344954:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 43 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.344960:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.344991:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 43 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.345003:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 43 pid: 6532 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360129.345016:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904184380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596084096:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360129.345104:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360129.349265:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.349422:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904184380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596084096:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360129.349447:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360129.350053:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575045376 00000100:00100000:0.0:1787360129.350066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575045376 00010000:00010000:0.0:1787360129.350097:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 44 pid: 6532 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360129.350135:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 85 00000100:00100000:0.0:1787360129.350144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+44:2400:x1874182575045376:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360129.350157:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360129.350163:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 44 pid: 6532 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350174:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 44 pid: 6532 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350194:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef238 expref: 44 pid: 6532 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350208:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360129.350213:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350221:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350270:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.350290:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360129.350338:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+43:2400:x1874182575045376:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 194us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360129.350352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 85 00010000:00010000:1.0:1787360129.350516:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.350524:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360129.350543:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787360129.350658:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697000/0x359a4e2aee720aeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 44 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.350673:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 43 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.350680:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360129.350682:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787360129.350696:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697c00, rc 0) 00000100:00100000:1.0:1787360129.350722:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+43:12282:x1874182575045248:12345-192.168.206.11@tcp:101:dd.0 Request processed in 6005us (6248us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787360129.350729:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:3.0:1787360129.353132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.353514:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575045504 00000100:00100000:0.0:1787360129.353523:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575045504 00000100:00100000:0.0:1787360129.353579:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 169 00000100:00100000:0.0:1787360129.353588:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+43:12282:x1874182575045504:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:0.0:1787360129.353608:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360129.353625:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720b00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef24d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.353654:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.353667:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.353677:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.354202:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720b00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 45 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.354221:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 44 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.354475:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360129.354478:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360129.354481:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeec00, rc 0) 00000100:00100000:0.0:1787360129.354541:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+44:12282:x1874182575045504:12345-192.168.206.11@tcp:101:dd.0 Request processed in 952us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360129.354554:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 169 00000100:00100000:3.0:1787360129.357929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.358498:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575045760 00000100:00100000:2.0:1787360129.358508:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575045760 00000100:00100000:2.0:1787360129.358563:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 170 00000100:00100000:2.0:1787360129.358573:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+44:12282:x1874182575045760:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:2.0:1787360129.358796:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.358813:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.358823:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360129.358864:0:11098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1787360129.358889:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fb921fc reply state 000000005c1bee61 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.358906:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.358913:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:2.0:1787360129.358916:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787360129.358919:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360129.359010:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fedd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+47:12282:x1874182575045760:12345-192.168.206.11@tcp:36:dd.0 Request processed in 437us (1088us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1787360129.359017:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 170 00000020:00080000:2.0:1787360129.359022:0:11098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787360129.669904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.670025:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575045888 00000100:00100000:2.0:1787360129.670036:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575045888 00000100:00100000:2.0:1787360129.670111:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:2.0:1787360129.670122:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+47:12297:x1874182575045888:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:2.0:1787360129.670144:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360129.670165:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720b15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef254 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670279:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670293:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670303:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670312:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670318:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670323:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670389:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670399:0:9449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 48 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670406:0:9449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670454:0:9449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 48 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360129.670468:0:9449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 48 pid: 9449 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360129.670481:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904184380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596084224:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360129.671110:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780900 going to sleep for 11 seconds 00000100:00100000:2.0:1787360129.684555:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904184380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9449:1874182596084224:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360129.684588:0:9449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360129.688432:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360129.688730:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046144 00000100:00100000:3.0:1787360129.688740:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046144 00000100:00100000:1.0:1787360129.688925:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360129.688946:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+49:6172:x1874182575046144:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787360129.689472:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+50:6172:x1874182575046144:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 486us (1007us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787360129.689498:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360129.693046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360129.694593:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046272 00000100:00100000:3.0:1787360129.694605:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046272 00010000:00010000:3.0:1787360129.694657:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 50 pid: 9449 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360129.694707:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:3.0:1787360129.694716:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+50:2400:x1874182575046272:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360129.694730:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360129.694736:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 50 pid: 9449 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694760:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 50 pid: 9449 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694784:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee720af2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef246 expref: 50 pid: 9449 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694801:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360129.694806:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694845:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694853:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360129.694888:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360129.695147:0:9449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695156:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360129.695214:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787360129.695218:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360129.695280:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695295:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695305:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695311:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695317:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695323:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360129.695327:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695335:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695355:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:1.0:1787360129.695362:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360129.695367:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695373:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720b1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695385:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695390:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695412:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695418:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360129.695426:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695433:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695440:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:1.0:1787360129.695442:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360129.695445:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695451:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720b23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695492:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720b15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef254 expref: 50 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695506:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef254 expref: 49 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360129.695514:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360129.695516:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360129.695518:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696a00, rc 0) 00000100:00100000:3.0:1787360129.695602:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+49:2400:x1874182575046272:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 885us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360129.695610:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 86 00000100:00100000:1.0:1787360129.697657:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+48:12297:x1874182575045888:12345-192.168.206.11@tcp:101:stat.0 Request processed in 27528us (27753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360129.697671:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 171 00000100:00100000:1.0:1787360129.801813:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.801929:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046528 00000100:00100000:0.0:1787360129.801939:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046528 00000100:00100000:0.0:1787360129.802002:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 172 00000100:00100000:0.0:1787360129.802013:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+48:12303:x1874182575046528:12345-192.168.206.11@tcp:36:truncate.0 00010000:00010000:0.0:1787360129.802071:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360129.802098:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720b2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef254 expref: 48 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.802117:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360129.802122:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360129.802334:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.802349:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.802359:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360129.802413:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787360129.802438:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b07dabb reply state 00000000de5e9c80 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.802580:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360129.802589:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360129.802591:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360129.802606:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360129.802705:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+50:12303:x1874182575046528:12345-192.168.206.11@tcp:36:truncate.0 Request processed in 692us (900us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787360129.802712:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 172 00000020:00080000:0.0:1787360129.802716:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787360129.896825:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.896869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.896903:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.896943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.896972:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047168 00000100:00100000:0.0:1787360129.896982:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047168 00000100:00100000:0.0:1787360129.897028:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046784 00000100:00100000:0.0:1787360129.897031:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046784 00000100:00100000:2.0:1787360129.897039:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046912 00000100:00100000:2.0:1787360129.897043:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046912 00000100:00100000:0.0:1787360129.897064:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 329 00000100:00100000:0.0:1787360129.897073:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182575047168:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360129.897087:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:2.0:1787360129.897093:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575046912:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360129.897164:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575046656 00000100:00100000:1.0:1787360129.897168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575046656 00000100:00100000:1.0:1787360129.897197:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 391 00000100:00100000:1.0:1787360129.897205:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182575046656:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360129.897265:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 330 00000100:00100000:3.0:1787360129.897274:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182575046784:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360129.897475:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182575047168:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 402us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360129.897483:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 329 00000100:00080000:0.0:1787360129.897502:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360129.897506:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360129.904891:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575046912:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 7785us (8008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360129.904905:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1787360129.910312:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2399:x1874182575046656:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 13095us (13485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360129.910327:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 391 00000100:00100000:3.0:1787360129.919918:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2399:x1874182575046784:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 22634us (22962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360129.919938:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 330 00000100:00100000:0.0:1787360129.924946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360129.925004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360129.925107:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047040 00000100:00100000:2.0:1787360129.925118:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047040 00000100:00100000:3.0:1787360129.925161:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047296 00000100:00100000:3.0:1787360129.925166:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047296 00000100:00100000:2.0:1787360129.925173:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:2.0:1787360129.925182:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575047040:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360129.925214:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 331 00000100:00100000:3.0:1787360129.925220:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182575047296:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360129.925262:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575047040:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360129.925274:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3b9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2399:x1874182575047296:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360129.925281:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 331 00000100:00100000:2.0:1787360129.925282:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00080000:1.0:1787360129.925630:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360130.041684:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.041786:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047424 00000100:00100000:0.0:1787360130.041796:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047424 00000100:00100000:0.0:1787360130.041879:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:0.0:1787360130.041892:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+50:12317:x1874182575047424:12345-192.168.206.11@tcp:101:stat.0 00010000:00010000:0.0:1787360130.041915:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360130.041936:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef25b expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042021:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042036:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042047:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042057:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042064:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042071:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042143:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042153:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042159:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360130.042198:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787360130.042203:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360130.042219:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787360130.042435:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787360130.042623:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042632:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042638:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042643:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042649:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.042652:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042659:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042671:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360130.042674:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.042679:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042685:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720b3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042699:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042704:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042716:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042721:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.042724:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042730:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042739:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:0.0:1787360130.042742:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.042744:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042762:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042791:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 52 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042804:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 51 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.042811:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.042814:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360130.042816:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefa00, rc 0) 00000100:00100000:0.0:1787360130.043415:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+51:12317:x1874182575047424:12345-192.168.206.11@tcp:101:stat.0 Request processed in 1524us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.043433:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 173 00000100:00100000:2.0:1787360130.156676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360130.156776:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047680 00000100:00100000:3.0:1787360130.156785:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047680 00000100:00100000:3.0:1787360130.156856:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:3.0:1787360130.156868:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+51:12327:x1874182575047680:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360130.156900:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360130.156930:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720b54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef262 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360130.157020:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787360130.157110:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720b54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef262 expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.157125:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:3.0:1787360130.157128:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360130.157134:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720b54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef262 expref: 53 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.157147:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9c00, rc 0) 00000100:00100000:3.0:1787360130.157214:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+52:12327:x1874182575047680:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 342us (539us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787360130.157221:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 174 00000100:00100000:3.0:1787360130.163317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.163400:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575047936 00000100:00100000:1.0:1787360130.163410:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575047936 00000100:00100000:1.0:1787360130.163468:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:1.0:1787360130.163478:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20564050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+52:12327:x1874182575047936:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360130.163758:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20564050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+53:12327:x1874182575047936:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 272us (441us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787360130.163766:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00010000:00010000:1.0:1787360130.169624:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360130.238943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.239018:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575048192 00000100:00100000:0.0:1787360130.239029:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575048192 00000100:00100000:0.0:1787360130.239089:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 175 00000100:00100000:0.0:1787360130.239100:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+53:12333:x1874182575048192:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360130.239122:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360130.239142:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef269 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.239560:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.239575:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 54 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.239583:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.239614:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 54 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.239628:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 54 pid: 11098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.239641:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596084352:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360130.239849:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a012ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360130.247360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.247795:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575048320 00000100:00100000:1.0:1787360130.247804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575048320 00010000:00010000:1.0:1787360130.247855:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 55 pid: 11098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360130.247894:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 87 00000100:00100000:1.0:1787360130.247905:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+55:2400:x1874182575048320:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360130.247927:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360130.247934:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 55 pid: 11098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.247948:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 55 pid: 11098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.247967:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.247971:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.247981:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.247989:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.248023:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360130.248079:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+55:2400:x1874182575048320:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 176us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.248087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 87 00010000:00010000:0.0:1787360130.249815:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef25b expref: 54 pid: 11098 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.249851:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1874182596084352:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360130.249871:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.249881:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.249888:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360130.249908:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787360130.250051:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 55 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.250068:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 54 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.250077:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.250080:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360130.250083:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef600, rc 0) 00000100:00100000:0.0:1787360130.250138:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+54:12333:x1874182575048192:12345-192.168.206.11@tcp:101:bash.0 Request processed in 11040us (11204us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787360130.250147:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 175 00000001:00080000:2.0:1787360130.256350:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:2.0:1787360130.256399:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787360130.256419:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998903a32c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787360130.256424:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998901f44200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998903a32840 00000020:00080000:2.0:1787360130.256427:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a13ddfb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998903740200 00000100:00100000:0.0:1787360130.256692:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596084480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787360130.256767:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.256815:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596084480 00000100:00100000:0.0:1787360130.256835:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596084480 00000100:00100000:0.0:1787360130.256886:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360130.256895:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596084480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787360130.256990:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1787360130.257020:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a88f380, atime: 0x6a88f380, ctime: 0x6a88f380, blocks: 0x8 00010000:00010000:0.0:1787360130.257028:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.257044:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:0.0:1787360130.257049:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360130.257054:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.257069:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.257079:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.257086:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.257104:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360130.257359:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360130.257365:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360130.257374:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360130.257379:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360130.257389:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360130.257603:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787360130.257638:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:1.0:1787360130.257647:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360130.257735:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3659:x1874182596084480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 839us (966us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787360130.257744:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1787360130.257821:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360130.257830:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007a03749/0x359a4e2aee720b77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360130.257862:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360130.257864:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360130.257866:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360130.258323:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258334:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258341:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258347:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a00030800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360130.258358:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258365:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258377:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff998a227ad900) 00010000:00010000:3.0:1787360130.258380:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360130.258384:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258389:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a00030800/0x359a4e2aee7209c5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258417:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258424:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258430:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258435:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a00031a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360130.258438:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258444:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258460:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360130.258463:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360130.258471:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258477:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031a00/0x359a4e2aee7209cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258493:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258499:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258506:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258510:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360130.258513:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258519:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258526:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a227ad100) 00010000:00010000:3.0:1787360130.258529:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360130.258532:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258538:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720a0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258550:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258565:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258572:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258577:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360130.258579:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258585:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258594:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360130.258596:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360130.258598:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258604:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697e00/0x359a4e2aee720b0e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258614:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258619:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258624:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258629:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360130.258638:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258644:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258653:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360130.258655:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360130.258657:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360130.258663:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720b31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360130.259380:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998a037a7480/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787360130.259398:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596084480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787360130.259568:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.259654:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575048576 00000100:00100000:0.0:1787360130.259667:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575048576 00000100:00100000:0.0:1787360130.259741:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 176 00000100:00100000:0.0:1787360130.259761:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+17:12333:x1874182575048576:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:0.0:1787360130.259968:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.259983:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.259993:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360130.260033:0:11098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787360130.260054:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5c65bf8 reply state 00000000bbc255c6 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.260065:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.260072:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.260074:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360130.260077:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360130.260154:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890388dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+20:12333:x1874182575048576:12345-192.168.206.11@tcp:36:bash.0 Request processed in 403us (587us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787360130.260161:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 176 00000020:00080000:0.0:1787360130.260165:0:11098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787360130.271087:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.271189:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575048704 00000100:00100000:0.0:1787360130.271199:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575048704 00000100:00100000:0.0:1787360130.271731:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 177 00000100:00100000:0.0:1787360130.271743:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+20:12333:x1874182575048704:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360130.271791:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360130.271811:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef270 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.271910:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.272185:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.272196:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.272363:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.272376:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 21 pid: 6532 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.272390:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596084608:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360130.272636:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a012ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360130.277157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.277254:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575048832 00000100:00100000:1.0:1787360130.277265:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575048832 00010000:00010000:1.0:1787360130.277303:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 22 pid: 6532 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360130.277343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:1.0:1787360130.277353:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575048832:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360130.277366:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360130.277373:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 22 pid: 6532 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.277386:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 22 pid: 6532 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.277415:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.277421:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.277456:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.277463:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.277480:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360130.277582:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720b69 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef269 expref: 22 pid: 6532 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.277597:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596084608:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360130.277614:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.277632:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.277639:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360130.277684:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787360130.277688:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360130.277705:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.277732:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef270 expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.277754:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef270 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.277763:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.277766:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360130.277768:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee400, rc 0) 00000100:00100000:1.0:1787360130.278890:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:2399:x1874182575048832:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 1534us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.278901:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 88 00000100:00100000:0.0:1787360130.279090:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+20:12333:x1874182575048704:12345-192.168.206.11@tcp:101:bash.0 Request processed in 7348us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.279099:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 177 00000100:00100000:3.0:1787360130.285312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.289476:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575049088 00000100:00100000:1.0:1787360130.289490:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575049088 00000100:00100000:1.0:1787360130.289562:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:1.0:1787360130.289572:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+20:12333:x1874182575049088:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:1.0:1787360130.289828:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:12333:x1874182575049088:12345-192.168.206.11@tcp:35:bash.0 Request processed in 257us (4523us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787360130.289836:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1787360130.297517:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596084992:0@lo:400:kworker.0 00000100:00100000:3.0:1787360130.297587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360130.297677:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596084736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.297708:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596084864:0@lo:400:kworker.0 00000100:00100000:2.0:1787360130.297718:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360130.297767:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360130.297802:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596084736 00000100:00100000:2.0:1787360130.297810:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596084736 00000100:00100000:1.0:1787360130.297835:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596085248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360130.297868:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787360130.297869:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360130.297881:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596084736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.297905:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085248 00000100:00100000:1.0:1787360130.297910:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085248 00000100:00100000:2.0:1787360130.297950:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3660:x1874182596084736:12345-0@lo:400:kworker.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.297954:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787360130.297962:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787360130.297967:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596085248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787360130.297991:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787360130.298024:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596084992 00000100:00100000:2.0:1787360130.298029:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596084992 00000100:00100000:1.0:1787360130.298043:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596085248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.298051:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787360130.298057:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787360130.298065:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596084992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298110:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596085248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360130.298122:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596084736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298146:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596085120:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298172:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360130.298202:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360130.298212:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596084864 00000100:00100000:1.0:1787360130.298216:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596084864 00000100:00100000:1.0:1787360130.298262:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085120 00000100:00100000:1.0:1787360130.298266:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085120 00000100:00100000:1.0:1787360130.298287:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787360130.298294:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596084864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298330:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596084864:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.298336:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1787360130.298348:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787360130.298353:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596085120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298381:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596085120:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.298387:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1787360130.298412:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596084864:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.298433:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596085120:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.300984:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596085376:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301051:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.301169:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360130.301176:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596085760:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301220:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.301275:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085376 00000100:00100000:0.0:1787360130.301282:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085376 00000100:00100000:0.0:1787360130.301325:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787360130.301334:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301385:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596085376:12345-0@lo:400:kworker.0 Request processed in 52us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.301392:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787360130.301429:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596085376:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301456:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085760 00000100:00100000:0.0:1787360130.301459:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085760 00000100:00100000:0.0:1787360130.301493:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787360130.301500:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596085760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301535:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596085760:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.301541:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787360130.301563:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596085760:0@lo:400:kworker.0 00000100:00080000:0.0:1787360130.301578:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360130.301609:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596085632:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301653:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.301674:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360130.301680:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596085504:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.301894:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.301925:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085632 00000100:00100000:0.0:1787360130.301930:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085632 00000100:00100000:0.0:1787360130.301957:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085504 00000100:00100000:0.0:1787360130.301966:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085504 00000100:00100000:0.0:1787360130.301991:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787360130.301998:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596085632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.302034:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989042b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596085632:12345-0@lo:400:kworker.0 Request processed in 37us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.302039:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787360130.302050:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787360130.302056:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596085504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.302081:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596085504:12345-0@lo:400:kworker.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.302087:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:0.0:1787360130.302099:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360130.302102:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360130.302119:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989042b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596085504:0@lo:400:kworker.0 00010000:00080000:0.0:1787360130.302130:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a037a4000 x1874182596085632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360130.302139:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596085632:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.302378:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360130.302395:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596085888:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.302426:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360130.302453:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596085888 00000100:00100000:1.0:1787360130.302457:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596085888 00000100:00100000:1.0:1787360130.302488:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787360130.302494:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596085888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.302527:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890434f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596085888:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.302533:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787360130.302558:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596085888:0@lo:400:kworker.0 00000100:00080000:0.0:1787360130.302628:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360130.302892:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890409a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596086144:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.302921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.302949:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360130.302955:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596086016:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.302977:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360130.303004:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596086144 00000100:00100000:0.0:1787360130.303008:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596086144 00000100:00100000:0.0:1787360130.303033:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596086016 00000100:00100000:0.0:1787360130.303043:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596086016 00000100:00100000:0.0:1787360130.303067:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787360130.303073:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.303109:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596086144:12345-0@lo:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.303115:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787360130.303127:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1787360130.303133:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596086016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.303159:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596086016:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.303165:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:0.0:1787360130.303178:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360130.303181:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360130.303197:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596086016:0@lo:400:kworker.0 00010000:00080000:0.0:1787360130.303207:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890409a680 x1874182596086144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360130.303216:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890409a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596086144:0@lo:400:kworker.0 00000100:00100000:1.0:1787360130.307246:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596086272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360130.307581:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596084992:12345-0@lo:400:kworker.0 Request processed in 9514us (9991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360130.307594:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787360130.307599:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360130.307683:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596084992:0@lo:400:kworker.0 00000100:00100000:0.0:1787360130.313695:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596086272 00000100:00100000:0.0:1787360130.313717:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596086272 00000100:00100000:0.0:1787360130.313959:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787360130.313969:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596086272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360130.313992:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787360130.314064:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596086272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.314072:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787360130.314285:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596086272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360130.414422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.414592:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575049344 00000100:00100000:0.0:1787360130.414615:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575049344 00000100:00100000:0.0:1787360130.414678:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 178 00000100:00100000:0.0:1787360130.414702:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:12343:x1874182575049344:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360130.414726:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360130.414755:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef277 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360130.414842:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787360130.415068:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef277 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.415084:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:0.0:1787360130.415087:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360130.415092:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef277 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.415106:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefa00, rc 0) 00000100:00100000:0.0:1787360130.415293:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:12343:x1874182575049344:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 593us (878us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787360130.415300:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 178 00000100:00100000:3.0:1787360130.420220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.420441:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575049472 00000100:00100000:0.0:1787360130.420461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575049472 00000100:00100000:0.0:1787360130.420521:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:0.0:1787360130.420531:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:12343:x1874182575049472:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360130.420604:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420621:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420645:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420660:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420667:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420674:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420770:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420779:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420786:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360130.420830:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420842:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420849:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420856:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420872:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.420877:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420884:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420895:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360130.420899:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.420903:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420909:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ba1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420934:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420941:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420947:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420952:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.420955:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420961:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420979:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8a00) 00010000:00010000:0.0:1787360130.420982:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.420985:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.420991:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720ba8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421005:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421011:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421017:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421021:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.421024:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421029:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421035:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.421038:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.421041:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.421047:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720baf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.421123:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:12343:x1874182575049472:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 593us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.421131:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 179 00000100:00100000:0.0:1787360130.427763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360130.427885:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575049728 00000100:00100000:2.0:1787360130.427895:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575049728 00000100:00100000:2.0:1787360130.427999:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:2.0:1787360130.428010:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+22:12343:x1874182575049728:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360130.428222:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:12343:x1874182575049728:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 213us (479us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787360130.428266:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:2.0:1787360130.483671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.483791:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575049984 00000100:00100000:1.0:1787360130.483802:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575049984 00000100:00100000:1.0:1787360130.483865:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:1.0:1787360130.483876:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+23:12347:x1874182575049984:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360130.483899:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360130.483930:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720bb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef27e expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484006:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484020:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484032:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484062:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484069:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484076:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484192:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484201:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484208:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360130.484218:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787360130.484336:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484344:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484351:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484357:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360130.484361:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484381:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484393:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:1.0:1787360130.484396:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360130.484401:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484407:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720bbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484421:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484428:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484434:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484440:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360130.484442:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484581:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484590:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a28ed0600) 00010000:00010000:1.0:1787360130.484592:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360130.484595:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484611:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484653:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720bb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef27e expref: 26 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484665:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef27e expref: 25 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.484673:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.484676:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360130.484678:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:1.0:1787360130.484975:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+25:12347:x1874182575049984:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1099us (1311us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787360130.484983:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 180 00000100:00100000:3.0:1787360130.510650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360130.510714:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.510735:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575050112 00000100:00100000:0.0:1787360130.510758:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575050112 00000100:00100000:0.0:1787360130.510822:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:0.0:1787360130.510833:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:12347:x1874182575050112:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1787360130.510899:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360130.511060:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575050240 00000100:00100000:1.0:1787360130.511065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575050240 00000100:00100000:1.0:1787360130.511106:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:1.0:1787360130.511114:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+26:2399:x1874182575050240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360130.511125:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360130.513571:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.513597:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.516609:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef27e expref: 26 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.516636:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.516641:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360130.516730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+25:2399:x1874182575050240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 5615us (6014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.516769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00010000:00010000:0.0:1787360130.518029:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518042:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518050:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518056:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.518061:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518085:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518098:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.518101:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360130.518105:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.518111:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720bd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360130.518188:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:12347:x1874182575050112:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 7354us (7556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.518197:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 181 00000100:00100000:3.0:1787360130.520364:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.522294:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575050496 00000100:00100000:1.0:1787360130.522308:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575050496 00000100:00100000:1.0:1787360130.522363:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:1.0:1787360130.522373:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:12347:x1874182575050496:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360130.522598:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:12347:x1874182575050496:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 225us (2241us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787360130.522606:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:3.0:1787360130.735991:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.736074:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575050752 00000100:00100000:1.0:1787360130.736084:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575050752 00000100:00100000:1.0:1787360130.736146:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:1.0:1787360130.736156:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+25:12365:x1874182575050752:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:1.0:1787360130.736181:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360130.736204:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720be0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef285 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.736339:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720be7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.736353:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720be7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.736363:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720be7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360130.736374:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787360130.736470:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720be0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef285 expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.736507:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720be7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef285 expref: 27 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.736515:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.736518:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787360130.736521:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71800, rc 0) 00000100:00100000:1.0:1787360130.736582:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+27:12365:x1874182575050752:12345-192.168.206.11@tcp:101:cat.0 Request processed in 428us (612us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787360130.736590:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 182 00000100:00100000:3.0:1787360130.785465:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.785546:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575050880 00000100:00100000:1.0:1787360130.785556:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575050880 00000100:00100000:1.0:1787360130.785611:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:1.0:1787360130.785622:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+27:12366:x1874182575050880:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360130.785643:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360130.785661:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef28c expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785731:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785756:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785770:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360130.785813:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787360130.785829:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360130.785848:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785872:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720bf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef28c expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785889:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef28c expref: 28 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.785898:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:1.0:1787360130.785900:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360130.785904:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70200, rc 0) 00000100:00100000:1.0:1787360130.785982:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+28:12366:x1874182575050880:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 353us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.785989:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 183 00000100:00100000:3.0:1787360130.797896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.798046:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051264 00000100:00100000:0.0:1787360130.798056:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051264 00000100:00100000:0.0:1787360130.798158:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:0.0:1787360130.798170:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+28:12366:x1874182575051264:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:0.0:1787360130.798480:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:12366:x1874182575051264:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 311us (590us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787360130.798487:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:3.0:1787360130.805732:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360130.805816:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051392 00000100:00100000:1.0:1787360130.805825:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051392 00000100:00100000:1.0:1787360130.805880:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:1.0:1787360130.805894:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+29:12366:x1874182575051392:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:1.0:1787360130.805907:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787360130.805929:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720b8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef270 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.805951:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720be7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef285 expref: 28 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.805964:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720a82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef22a expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360130.805982:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360130.805987:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360130.806049:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+26:12366:x1874182575051392:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 156us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360130.806056:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1787360130.811798:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.812982:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051520 00000100:00100000:0.0:1787360130.812994:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051520 00000100:00100000:0.0:1787360130.813058:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:0.0:1787360130.813067:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+26:12366:x1874182575051520:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:0.0:1787360130.813186:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.813218:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.813246:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360130.813333:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787360130.813421:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+26:12366:x1874182575051520:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 354us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.813429:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 184 00000100:00100000:2.0:1787360130.838324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360130.838728:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051648 00000100:00100000:0.0:1787360130.838737:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051648 00000100:00100000:0.0:1787360130.838804:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 185 00000100:00100000:0.0:1787360130.838814:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+26:12368:x1874182575051648:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360130.838833:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360130.838851:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720c0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef293 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838911:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838926:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838937:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838950:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838974:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.838981:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839069:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839079:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839086:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360130.839129:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787360130.839133:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360130.839151:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839164:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839172:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839178:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839184:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839200:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.839205:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839212:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839266:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360130.839270:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.839274:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839280:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720c11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839294:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839300:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839305:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839310:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360130.839312:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839317:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839335:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8a00) 00010000:00010000:0.0:1787360130.839338:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360130.839341:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839346:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720c18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839377:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 28 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839392:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360130.839399:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360130.839402:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360130.839404:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:0.0:1787360130.839470:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+27:12368:x1874182575051648:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 656us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360130.839477:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 185 00010000:00010000:0.0:1787360131.194813:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360131.321398:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596086400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360131.321466:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360131.321538:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596086400 00000100:00100000:1.0:1787360131.321545:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596086400 00000100:00100000:1.0:1787360131.321590:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787360131.321598:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596086400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360131.321632:0:7862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787360131.321675:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596086400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.321683:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787360131.321726:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596086400:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787360131.322956:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360131.322963:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360131.322989:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787360131.322996:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360131.323120:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596086528:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787360131.323194:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a42140000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360131.334579:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.334616:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051776 00000100:00100000:3.0:1787360131.334624:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051776 00000100:00100000:3.0:1787360131.334674:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:3.0:1787360131.334684:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575051776:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787360131.334726:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787360131.334832:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575051776:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 149us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.334840:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 186 00000100:00100000:3.0:1787360131.334964:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596086528:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787360131.339754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360131.339831:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575051904 00000100:00100000:1.0:1787360131.339840:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575051904 00000100:00100000:1.0:1787360131.339901:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:1.0:1787360131.339912:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+27:12379:x1874182575051904:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787360131.339977:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.339993:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340023:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340049:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340056:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340063:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340516:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340529:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340537:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360131.340729:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787360131.340734:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360131.340756:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340768:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340776:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340795:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340801:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360131.340806:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340813:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340825:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:1.0:1787360131.340829:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360131.340833:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340840:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340852:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340858:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340865:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340875:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360131.340879:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340896:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340905:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff998a28ed0600) 00010000:00010000:1.0:1787360131.340908:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360131.340912:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340918:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340932:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340938:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340944:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340949:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360131.340952:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340958:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340965:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360131.340968:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360131.340970:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.340986:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee720c34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.341072:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+27:12379:x1874182575051904:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 1161us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.341089:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 187 00000100:00100000:2.0:1787360131.347956:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.347992:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575052160 00000100:00100000:2.0:1787360131.348001:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575052160 00000100:00100000:2.0:1787360131.348062:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:2.0:1787360131.348074:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+27:12379:x1874182575052160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360131.348093:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360131.348113:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720c3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef29a expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348245:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348261:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348273:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360131.348292:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787360131.348373:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348381:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348387:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348393:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360131.348397:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348403:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348415:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:2.0:1787360131.348417:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360131.348421:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348427:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348465:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720c3b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef29a expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348475:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:2.0:1787360131.348477:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360131.348488:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720c3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef29a expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.348498:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697a00, rc 0) 00000100:00100000:2.0:1787360131.348562:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 489us (612us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1787360131.348569:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 188 00000100:00100000:0.0:1787360131.368490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.370195:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575052288 00000100:00100000:2.0:1787360131.370207:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575052288 00000100:00100000:2.0:1787360131.370290:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:2.0:1787360131.370301:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052288:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360131.370333:0:6532:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360131.370459:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052288:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 159us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360131.370468:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 189 00000100:00100000:3.0:1787360131.374992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.376178:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575052544 00000100:00100000:2.0:1787360131.376192:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575052544 00000100:00100000:2.0:1787360131.376266:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:2.0:1787360131.376277:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360131.376297:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360131.376301:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787360131.376327:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70200/0x359a4e2aee720bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef28c expref: 28 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.376345:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360131.376350:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360131.376363:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2a1 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360131.378213:0:9449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787360131.378367:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720c57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.378382:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.378393:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720c57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.378466:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720c50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a1 expref: 30 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.378484:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720c57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a1 expref: 29 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.378493:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a07fdb700) 00010000:00010000:2.0:1787360131.378496:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360131.378499:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787360131.378562:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+29:12379:x1874182575052544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2286us (3578us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787360131.378571:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 190 00000100:00100000:2.0:1787360131.384011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.384158:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575052800 00000100:00100000:3.0:1787360131.384168:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575052800 00000100:00100000:3.0:1787360131.384261:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:3.0:1787360131.384271:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+29:12379:x1874182575052800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.384330:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360131.384359:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720c57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a1 expref: 29 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384375:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a07fdb700) 00010000:00010000:3.0:1787360131.384385:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360131.384406:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384418:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384441:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384455:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384462:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384467:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384508:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384514:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384521:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384526:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360131.384531:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384538:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384548:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360131.384551:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360131.384555:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384566:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c65 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384580:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384586:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384591:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384596:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360131.384598:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384604:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384611:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4ac3edca (ffff998902718100) 00010000:00010000:3.0:1787360131.384613:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360131.384616:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.384622:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c6c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4ac3edca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.384710:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 440us (706us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360131.384718:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 191 00000100:00100000:0.0:1787360131.387046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360131.387099:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575052928 00000100:00100000:1.0:1787360131.387109:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575052928 00000100:00100000:1.0:1787360131.387164:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:1.0:1787360131.387173:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+28:12379:x1874182575052928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360131.387191:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360131.387221:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2a8 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387274:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387286:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387296:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387394:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71800/0x359a4e2aee720c73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 30 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387411:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 29 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.387430:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:1.0:1787360131.387433:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360131.387436:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70a00, rc 0) 00000100:00100000:1.0:1787360131.387493:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+29:12379:x1874182575052928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 321us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.387501:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 192 00000100:00100000:1.0:1787360131.390709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.390856:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575053184 00000100:00100000:3.0:1787360131.390867:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575053184 00000100:00100000:3.0:1787360131.391669:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:3.0:1787360131.391684:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+29:12379:x1874182575053184:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.391778:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.391795:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.391805:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360131.391969:0:11098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787360131.391979:0:11098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409638752333ns, next at 410638750233ns, rc = 0 00000004:00010000:3.0:1787360131.392025:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020a97f8c reply state 000000001038bc61 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.392037:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.392044:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.392047:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787360131.392051:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360131.392150:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+31:12379:x1874182575053184:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 471us (1449us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787360131.392158:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 193 00000100:00100000:1.0:1787360131.394543:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.394808:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575053312 00000100:00100000:3.0:1787360131.394817:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575053312 00000100:00100000:3.0:1787360131.394921:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:3.0:1787360131.394931:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+31:12379:x1874182575053312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.394959:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360131.394979:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.395029:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.395042:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 32 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.395059:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.395062:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360131.395066:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8000, rc 0) 00000100:00100000:3.0:1787360131.395151:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+32:12379:x1874182575053312:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 220us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.395158:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 194 00000100:00100000:1.0:1787360131.399846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.399924:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575053440 00000100:00100000:2.0:1787360131.399934:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575053440 00000100:00100000:2.0:1787360131.399996:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:2.0:1787360131.400006:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+6:2399:x1874182575053440:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787360131.400048:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360131.400269:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575053440:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 263us (430us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787360131.400277:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1787360131.402579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.402715:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575053696 00000100:00100000:3.0:1787360131.402724:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575053696 00000100:00100000:3.0:1787360131.402787:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1787360131.402799:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:12379:x1874182575053696:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360131.403002:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+33:12379:x1874182575053696:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 204us (430us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787360131.403010:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:1.0:1787360131.407202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.407628:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575053952 00000100:00100000:3.0:1787360131.407638:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575053952 00000100:00100000:3.0:1787360131.407696:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:3.0:1787360131.407706:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+33:12379:x1874182575053952:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360131.407834:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+33:12379:x1874182575053952:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 130us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.407842:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 195 00000100:00100000:1.0:1787360131.416759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.416874:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054080 00000100:00100000:3.0:1787360131.416885:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054080 00000100:00100000:3.0:1787360131.416974:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:3.0:1787360131.416985:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+33:12379:x1874182575054080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.417003:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360131.417032:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2b6 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417114:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417129:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417141:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360131.417181:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360131.417208:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417532:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720c8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2b6 expref: 35 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417549:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2b6 expref: 34 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.417570:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.417572:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787360131.417576:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8c00, rc 0) 00000100:00100000:3.0:1787360131.417632:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+34:12379:x1874182575054080:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 649us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.417639:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 196 00000100:00100000:1.0:1787360131.421889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.425006:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054208 00000100:00100000:3.0:1787360131.425087:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054208 00000100:00100000:3.0:1787360131.425179:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360131.425190:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575054208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.425214:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360131.425249:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2bd expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360131.425272:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f383, blocks: 0x0 00010000:00010000:3.0:1787360131.425289:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1787360131.425294:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360131.425303:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 8 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.425318:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 8 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.425330:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9600, rc 0) 00000100:00100000:3.0:1787360131.425392:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2401:x1874182575054208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 204us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.425398:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360131.435311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.435449:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054464 00000100:00100000:2.0:1787360131.435459:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054464 00000100:00100000:2.0:1787360131.435507:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:2.0:1787360131.435516:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+34:12379:x1874182575054464:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787360131.435618:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+34:12379:x1874182575054464:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360131.435625:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 197 00000100:00100000:2.0:1787360131.453846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.453916:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054592 00000100:00100000:0.0:1787360131.453926:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054592 00000100:00100000:0.0:1787360131.453977:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:0.0:1787360131.453988:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:12379:x1874182575054592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360131.454028:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360131.454047:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2c4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.454080:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.454089:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360131.454094:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360131.454099:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.454134:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.454148:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.454162:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596086656:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360131.454315:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360131.456719:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596086656:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360131.456761:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.456780:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeea00, rc 0) 00000100:00100000:0.0:1787360131.456850:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fc33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:12379:x1874182575054592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 2864us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360131.456860:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1787360131.464061:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.464153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054720 00000100:00100000:2.0:1787360131.464163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054720 00010000:00010000:2.0:1787360131.464211:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.464273:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:2.0:1787360131.464283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575054720:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360131.464297:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360131.464316:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.464331:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.464373:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002960b750/0x359a4e2aee720c9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2bd expref: 9 pid: 8770 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.464401:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360131.464406:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360131.464414:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.464423:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.464463:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.464477:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874182596086784:192.168.206.11@tcp:105: 00000100:00100000:2.0:1787360131.464554:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0fed6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787360131.479559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360131.479711:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6517:1874182596086784:192.168.206.11@tcp:105: 00010000:00010000:1.0:1787360131.479739:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360131.479816:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575054720:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 15532us (15763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.479827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 89 00000100:00100000:3.0:1787360131.480289:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054848 00000100:00100000:3.0:1787360131.480296:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054848 00002000:00100000:3.0:1787360131.480553:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9989040a1f80 x1874182575054848/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:322/0 lens 504/0 e 0 to 0 dl 1787360142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360131.480564:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989040a1f80 with x1874182575054848 ext(0->8) 00002000:00010000:3.0:1787360131.480569:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9989040a1f80 00000100:00100000:3.0:1787360131.480606:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1787360131.480621:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575054848:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787360131.485459:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+10:2400:x1874182575054848:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 4834us (5897us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787360131.485474:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00002000:00100000:3.0:1787360131.485488:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9989040a1f80 x1874182575054848/t4294967315(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:322/0 lens 504/448 e 0 to 0 dl 1787360142 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360131.485498:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9989040a1f80 with x1874182575054848 ext(0->8) 00002000:00010000:3.0:1787360131.485503:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9989040a1f80 00000100:00100000:2.0:1787360131.490912:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.491024:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575054976 00000100:00100000:0.0:1787360131.491034:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575054976 00000100:00100000:0.0:1787360131.491099:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 198 00000100:00100000:0.0:1787360131.491110:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+34:12379:x1874182575054976:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787360131.497070:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787360131.497086:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787360131.497125:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1787360131.497304:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:12379:x1874182575054976:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 6190us (6395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360131.497314:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 198 00000020:00080000:1.0:1787360131.497661:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787360131.497672:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787360131.497686:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596086912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787360131.497737:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360131.497796:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596086912 00000100:00100000:1.0:1787360131.497803:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596086912 00000100:00100000:1.0:1787360131.497853:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360131.497862:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596086912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787360131.497969:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787360131.497972:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787360131 00002000:00010000:1.0:1787360131.497975:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787360131.497977:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787360131 -> 1787360131 00002000:00010000:1.0:1787360131.497980:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787360131.498026:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1874182596086912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (275us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787360131.498034:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1787360131.498070:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99890415a680/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787360131.498075:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596086912:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787360131.498653:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498663:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498683:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498690:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeee00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360131.498694:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498702:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498719:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360131.498722:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360131.498726:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498733:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeee00/0x359a4e2aee720b7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498766:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498774:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498779:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498784:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360131.498787:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498803:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498812:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.498814:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360131.498816:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.498822:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720c81 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.500361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.500485:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575055104 00000100:00100000:3.0:1787360131.500494:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575055104 00000100:00100000:3.0:1787360131.500547:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1787360131.500558:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+10:2401:x1874182575055104:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787360131.503735:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1787360131.503760:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787360131.503915:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575055104:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 3353us (3555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.503925:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360131.506047:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.506164:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575055360 00000100:00100000:3.0:1787360131.506174:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575055360 00000100:00100000:3.0:1787360131.506264:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:3.0:1787360131.506275:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:12379:x1874182575055360:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.506325:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360131.506352:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720c96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2b6 expref: 19 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.506370:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.506384:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360131.506426:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.506440:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.506450:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360131.506560:0:11098:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007c83a0a reply state 000000001310ddbe transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.506572:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.506577:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360131.506580:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360131.506583:0:11098:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360131.506665:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+20:12379:x1874182575055360:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 391us (624us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787360131.506673:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 199 00000100:00100000:0.0:1787360131.516399:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.516524:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575055488 00000100:00100000:2.0:1787360131.516533:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575055488 00000100:00100000:2.0:1787360131.517185:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1787360131.517197:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575055488:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787360131.517510:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787360131.517514:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787360131 -> 1787360130 00002000:00010000:2.0:1787360131.517517:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787360128 00002000:00010000:2.0:1787360131.517520:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787360131 -> 1787360130 00002000:00010000:2.0:1787360131.517522:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787360131.518404:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575055488:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 1204us (2015us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787360131.518415:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1787360131.521417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.521492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575055744 00000100:00100000:3.0:1787360131.521501:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575055744 00000100:00100000:3.0:1787360131.521566:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:3.0:1787360131.521575:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:12379:x1874182575055744:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.521632:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.521647:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.521673:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.521704:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.521716:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 20 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.521729:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596087040:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360131.521821:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360131.554101:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596087040:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360131.554130:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.562114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360131.562159:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575055872 00000100:00100000:2.0:1787360131.562168:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575055872 00010000:00010000:2.0:1787360131.562207:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 21 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.562257:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 90 00000100:00100000:2.0:1787360131.562268:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:2399:x1874182575055872:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360131.562281:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360131.562288:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 21 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562302:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 21 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562331:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720c7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2a8 expref: 21 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562344:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:2.0:1787360131.562349:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562358:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562366:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562388:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360131.562432:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+20:2399:x1874182575055872:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 166us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360131.562440:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 90 00010000:00010000:2.0:1787360131.562468:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562476:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562525:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562532:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562539:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562550:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360131.562554:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562561:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562570:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:2.0:1787360131.562573:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787360131.562577:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.562583:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee720cb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.562620:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+19:12379:x1874182575055744:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 41046us (41210us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787360131.562629:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 200 00000100:00100000:2.0:1787360131.573206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.573362:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056000 00000100:00100000:3.0:1787360131.573372:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056000 00000100:00100000:3.0:1787360131.573427:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:3.0:1787360131.573437:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2402:x1874182575056000:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.573482:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.573605:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.573617:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360131.573635:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360131.573640:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.573675:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.573689:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 8 pid: 8448 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.573703:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596087168:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360131.573792:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360131.578313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.578438:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bcb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596087168:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360131.578466:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.578982:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056128 00000100:00100000:1.0:1787360131.578990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056128 00010000:00010000:1.0:1787360131.579027:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.579114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 91 00000100:00100000:1.0:1787360131.579125:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575056128:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360131.579138:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360131.579163:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.579176:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.579208:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abea2b38/0x359a4e2aee720ca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2c4 expref: 9 pid: 8448 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.579221:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360131.579370:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360131.579376:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.579386:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.579414:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360131.579466:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575056128:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 343us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.579475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 91 00010000:00010000:0.0:1787360131.579703:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579713:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579732:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579752:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579761:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579780:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360131.579784:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579792:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579817:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.579824:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee720cb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.579870:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2402:x1874182575056000:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 6434us (6673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360131.579877:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360131.594324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.594425:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056384 00000100:00100000:3.0:1787360131.594435:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056384 00000100:00100000:3.0:1787360131.594486:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 201 00000100:00100000:3.0:1787360131.594497:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+19:12379:x1874182575056384:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787360131.594579:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.594597:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.594607:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.594639:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.594669:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 19 pid: 6533 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.594685:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087296:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360131.597337:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360131.600112:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087296:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360131.600143:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360131.607141:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.607221:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056512 00000100:00100000:3.0:1787360131.607255:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056512 00010000:00010000:3.0:1787360131.607293:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 20 pid: 6533 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.607328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 92 00000100:00100000:3.0:1787360131.607338:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+20:2400:x1874182575056512:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360131.607351:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360131.607358:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 20 pid: 6533 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607371:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 20 pid: 6533 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607391:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef24d expref: 20 pid: 6533 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607417:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:3.0:1787360131.607422:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607505:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607515:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.607549:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360131.607598:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+19:2400:x1874182575056512:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 261us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360131.607607:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 92 00010000:00010000:1.0:1787360131.609242:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609256:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609417:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609433:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609452:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609490:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.609505:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 19 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.609519:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087424:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360131.609606:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787360131.614367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360131.614408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056640 00000100:00100000:1.0:1787360131.614418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056640 00010000:00010000:1.0:1787360131.614455:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 20 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.614488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 93 00000100:00100000:1.0:1787360131.614499:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+20:2400:x1874182575056640:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360131.614513:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360131.614519:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 20 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.614532:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 20 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.614572:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:1.0:1787360131.614577:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.614586:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.614594:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.614611:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360131.614657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+20:2400:x1874182575056640:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 161us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.614665:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 93 00010000:00010000:3.0:1787360131.614823:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720c88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2af expref: 19 pid: 6532 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.614840:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087424:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360131.614862:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.614871:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360131.614877:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360131.614978:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787360131.615093:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787360131.615129:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787360131.615205:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596087552:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360131.615922:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360131.615964:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a50e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360131.616280:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596087552 00000100:00100000:1.0:1787360131.616287:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596087552 00000100:00100000:1.0:1787360131.616336:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787360131.616345:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1874182596087552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360131.616433:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6533:x1874182596087552:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360131.616440:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787360131.616477:0:6533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1787360131.616482:0:6533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99890415a680, transno 4294967316 00000100:00100000:1.0:1787360131.616496:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903bc8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596087552:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787360131.616628:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1787360131.616693:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596087680:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360131.616721:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360131.616760:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360131.616813:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596087680 00000100:00100000:3.0:1787360131.616819:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596087680 00000100:00100000:3.0:1787360131.616856:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787360131.616864:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6533:x1874182596087680:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360131.616977:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6533:x1874182596087680:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (253us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787360131.616984:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787360131.617671:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596087680:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787360131.617714:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617725:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617733:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617750:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360131.617755:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617763:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617777:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:1.0:1787360131.617780:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360131.617784:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617790:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617810:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617817:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617823:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617834:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360131.617837:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617843:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617852:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:1.0:1787360131.617855:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360131.617857:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617863:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720c03 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617885:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617899:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617908:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617934:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.617947:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 22 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360131.617971:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087808:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360131.618043:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a670a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360131.622400:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596087808:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360131.622429:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360131.626103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.626277:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575056768 00000100:00100000:0.0:1787360131.626286:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575056768 00010000:00010000:0.0:1787360131.626326:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 23 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.626379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 94 00000100:00100000:0.0:1787360131.626390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+23:2399:x1874182575056768:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360131.626410:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360131.626417:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 23 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626430:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 23 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626451:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720c1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef293 expref: 23 pid: 6531 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626465:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360131.626470:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626481:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626488:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626525:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360131.626587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575056768:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360131.626594:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 94 00010000:00010000:0.0:1787360131.626623:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626640:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626650:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626656:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626662:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626667:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.626670:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626678:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626687:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360131.626689:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.626693:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626698:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70e00/0x359a4e2aee720cce lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626708:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626713:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626724:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626729:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.626732:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626749:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626758:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a28ed0c00) 00010000:00010000:0.0:1787360131.626761:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360131.626763:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.626770:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720cc0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.626901:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:12379:x1874182575056384:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 32405us (32586us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787360131.626909:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 201 00000020:00080000:0.0:1787360131.626914:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787360131.627026:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360131.627032:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360131.627536:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787360131.627547:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360131.636341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360131.636572:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575057024 00000100:00100000:1.0:1787360131.636584:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575057024 00000100:00100000:1.0:1787360131.636678:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:1.0:1787360131.636688:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20565050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:12379:x1874182575057024:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787360131.636949:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787360131.636982:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1787360131.637015:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637031:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637041:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637048:0:6535:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637055:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637061:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360131.637088:0:6535:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360131.637177:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20565050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+23:12379:x1874182575057024:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 489us (843us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787360131.637192:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000020:00080000:1.0:1787360131.637197:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787360131.637315:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360131.637322:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.637329:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360131.637333:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.637347:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.637359:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:2.0:1787360131.637362:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787360131.637366:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.637371:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee720cd5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360131.637382:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360131.637384:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360131.637386:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360131.696819:0:14719:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360131.696829:0:14719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360131.696852:0:14719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787360131.696858:0:14719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360131.847518:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.852823:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575057280 00000100:00100000:0.0:1787360131.852840:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575057280 00000100:00100000:0.0:1787360131.852903:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:0.0:1787360131.852914:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+23:12389:x1874182575057280:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360131.852943:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360131.852963:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720cdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2cb expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.853068:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ce3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.853082:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.853094:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360131.853103:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787360131.853197:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720cdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2cb expref: 26 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.853211:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2cb expref: 25 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.853220:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360131.853222:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360131.853257:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef600, rc 0) 00000100:00100000:0.0:1787360131.853319:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3c9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+25:12389:x1874182575057280:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 407us (5809us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787360131.853327:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 202 00000100:00100000:3.0:1787360131.865799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.869292:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575057408 00000100:00100000:0.0:1787360131.869306:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575057408 00000100:00100000:0.0:1787360131.869367:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:0.0:1787360131.869384:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+25:12389:x1874182575057408:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360131.869517:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.869533:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.869544:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.869559:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.869566:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.869582:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871086:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871113:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871124:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360131.871188:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871200:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871213:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871220:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871245:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.871250:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871257:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871269:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360131.871272:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.871276:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871283:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720cf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871296:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871302:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871308:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871313:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.871321:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871328:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871335:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8a00) 00010000:00010000:0.0:1787360131.871338:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.871341:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871347:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720cf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871361:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871367:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871372:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871377:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.871380:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871386:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871392:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8500) 00010000:00010000:0.0:1787360131.871394:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.871402:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.871407:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720cff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.871500:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+25:12389:x1874182575057408:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 2115us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360131.871510:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 203 00000100:00100000:1.0:1787360131.931378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.931637:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575057664 00000100:00100000:0.0:1787360131.931647:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575057664 00000100:00100000:0.0:1787360131.931707:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00100000:0.0:1787360131.931717:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+25:12392:x1874182575057664:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360131.931736:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360131.931767:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2d2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.931834:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.931848:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.931859:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.931874:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.931881:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932143:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932338:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932347:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932353:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360131.932363:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787360131.932436:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932443:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932450:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932457:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.932461:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932468:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932479:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360131.932482:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.932494:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932500:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee600/0x359a4e2aee720d0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932514:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932519:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932524:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932528:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.932530:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932535:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932541:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8500) 00010000:00010000:0.0:1787360131.932543:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360131.932546:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932550:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932721:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932760:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.932768:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360131.932770:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360131.932772:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:0.0:1787360131.934220:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:12392:x1874182575057664:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 2497us (2844us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787360131.934361:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 204 00000100:00100000:2.0:1787360131.941847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360131.941952:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575057792 00000100:00100000:0.0:1787360131.941961:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575057792 00000100:00100000:0.0:1787360131.942017:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:0.0:1787360131.942027:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+27:12392:x1874182575057792:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1787360131.942088:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942104:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942116:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942149:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942156:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942179:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942185:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360131.942189:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942196:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942208:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360131.942211:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360131.942215:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360131.942221:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720d29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360131.942315:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+27:12392:x1874182575057792:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 289us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360131.942323:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 205 00000100:00100000:0.0:1787360131.951222:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360131.952019:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058048 00000100:00100000:3.0:1787360131.952030:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058048 00000100:00100000:3.0:1787360131.952078:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:3.0:1787360131.952088:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+27:12392:x1874182575058048:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360131.952378:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+28:12392:x1874182575058048:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 290us (1163us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787360131.952496:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1787360132.000849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.000947:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058304 00000100:00100000:2.0:1787360132.000957:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058304 00000100:00100000:2.0:1787360132.001034:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00100000:2.0:1787360132.001044:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+28:11922:x1874182575058304:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360132.001065:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360132.001084:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720d30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2d9 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.001177:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.001202:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.001210:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787360132.001449:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360132.002474:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 29 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.002493:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 29 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.002768:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596087936:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360132.003688:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a136133c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360132.006695:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.006814:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904193800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596087936:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360132.006840:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.006961:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058432 00000100:00100000:1.0:1787360132.006969:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058432 00010000:00010000:1.0:1787360132.007004:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 30 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.007080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 95 00000100:00100000:1.0:1787360132.007090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+30:2399:x1874182575058432:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360132.007105:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360132.007112:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 30 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007124:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 30 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007147:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720d1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d2 expref: 30 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007162:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:1.0:1787360132.007167:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007176:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.007222:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360132.007319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:2399:x1874182575058432:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 230us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360132.007327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 95 00010000:00010000:3.0:1787360132.007450:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.007458:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360132.007476:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787360132.007671:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720d30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 30 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.007688:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.007695:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:3.0:1787360132.007697:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787360132.007699:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696200, rc 0) 00000100:00100000:3.0:1787360132.007727:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+29:11922:x1874182575058304:12345-192.168.206.11@tcp:101:bash.0 Request processed in 6685us (6888us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1787360132.007734:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 206 00000100:00100000:0.0:1787360132.012378:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360132.012474:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058560 00000100:00100000:1.0:1787360132.012484:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058560 00000100:00100000:1.0:1787360132.012537:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 207 00000100:00100000:1.0:1787360132.012547:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+29:11922:x1874182575058560:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:1.0:1787360132.012567:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360132.012602:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720d45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2e0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012633:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720d4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012646:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012656:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012779:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71400/0x359a4e2aee720d45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e0 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012797:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e0 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.012813:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:1.0:1787360132.012816:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360132.012819:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:1.0:1787360132.012877:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+30:11922:x1874182575058560:12345-192.168.206.11@tcp:101:bash.0 Request processed in 331us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360132.012886:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 207 00000100:00100000:2.0:1787360132.016980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.017074:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058816 00000100:00100000:0.0:1787360132.017084:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058816 00000100:00100000:0.0:1787360132.017144:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 208 00000100:00100000:0.0:1787360132.017155:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+30:11922:x1874182575058816:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:0.0:1787360132.017785:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.017815:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.017826:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360132.017871:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1787360132.017893:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b87d999 reply state 00000000d4654989 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.017906:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.017913:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.017915:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360132.017919:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787360132.017990:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1787360132.018138:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+34:11922:x1874182575058816:12345-192.168.206.11@tcp:36:bash.0 Request processed in 983us (1164us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787360132.018145:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 208 00000020:00080000:0.0:1787360132.018150:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787360132.020732:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.020867:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575058944 00000100:00100000:3.0:1787360132.020888:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575058944 00000100:00100000:3.0:1787360132.020942:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:3.0:1787360132.020953:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+34:11922:x1874182575058944:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360132.020974:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360132.020993:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720d5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2e7 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.021043:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720d5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e7 expref: 35 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.021056:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720d5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e7 expref: 35 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.021073:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:3.0:1787360132.021076:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360132.021079:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8000, rc 0) 00000100:00100000:3.0:1787360132.021171:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+35:11922:x1874182575058944:12345-192.168.206.11@tcp:101:bash.0 Request processed in 220us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360132.021178:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 209 00000100:00100000:3.0:1787360132.023585:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.023696:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059072 00000100:00100000:0.0:1787360132.023704:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059072 00000100:00100000:0.0:1787360132.023810:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:0.0:1787360132.023821:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:11922:x1874182575059072:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360132.023837:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.023855:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2ee expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360132.023895:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a88f382, atime: 0x6a88f380, ctime: 0x6a88f382, blocks: 0x8 00010000:00010000:0.0:1787360132.023915:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1787360132.023919:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360132.023926:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.023944:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 8 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.023956:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee600, rc 0) 00000100:00100000:0.0:1787360132.024016:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:11922:x1874182575059072:12345-192.168.206.11@tcp:101:bash.0 Request processed in 196us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.024022:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:3.0:1787360132.026046:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360132.026154:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059200 00000100:00100000:1.0:1787360132.026162:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059200 00002000:00010000:1.0:1787360132.026197:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787360132.026201:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99890492d500 with x1874182575059200 ext(0->18446744073709551615) 00002000:00010000:1.0:1787360132.026212:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99890492d500. 00000100:00100000:1.0:1787360132.026273:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1787360132.026283:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575059200:12345-192.168.206.11@tcp:10:bash.0 00002000:00010000:1.0:1787360132.026516:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787360132.026519:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787360130 -> 1787360131 00002000:00010000:1.0:1787360132.026522:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787360128 -> 1787360128 00002000:00010000:1.0:1787360132.026525:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787360130 -> 1787360131 00002000:00010000:1.0:1787360132.026528:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1787360132.026574:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575059200:12345-192.168.206.11@tcp:10:bash.0 Request processed in 292us (538us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787360132.026581:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00002000:00010000:1.0:1787360132.026585:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1787360132.026588:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99890492d500 with x1874182575059200 ext(0->18446744073709551615) 00002000:00010000:1.0:1787360132.026592:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99890492d500. 00000100:00100000:1.0:1787360132.103065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.103164:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059328 00000100:00100000:0.0:1787360132.103175:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059328 00000100:00100000:0.0:1787360132.103289:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:0.0:1787360132.103305:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:12406:x1874182575059328:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360132.103391:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103421:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103434:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103474:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103488:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103496:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103581:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103591:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103598:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360132.103653:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103671:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103677:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103684:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103690:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.103694:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103715:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103728:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.103731:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.103735:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103752:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103765:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103771:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103776:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103781:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.103783:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103789:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103795:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.103798:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.103800:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103817:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103842:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103849:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103854:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103859:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.103867:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103874:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103881:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.103884:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.103887:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.103897:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.103979:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+35:12406:x1874182575059328:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 679us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.103986:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 210 00000100:00100000:3.0:1787360132.178610:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.179134:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059584 00000100:00100000:0.0:1787360132.179144:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059584 00000100:00100000:0.0:1787360132.179205:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:0.0:1787360132.179215:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+35:12409:x1874182575059584:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360132.179260:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.179282:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2f5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179353:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179384:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179395:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179409:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179416:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179422:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179540:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720d92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179550:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179575:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360132.179585:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787360132.179673:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179680:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179685:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179691:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.179695:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179702:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179713:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.179715:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.179719:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179725:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179746:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179752:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179763:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.179768:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.180089:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180097:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180106:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.180109:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.180112:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180118:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180158:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720d7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2f5 expref: 38 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180170:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2f5 expref: 37 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.180177:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.180179:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360132.180181:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefc00, rc 0) 00000100:00100000:0.0:1787360132.180411:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:12409:x1874182575059584:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1196us (1808us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787360132.180427:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 211 00000100:00100000:3.0:1787360132.186196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360132.190880:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059712 00000100:00100000:1.0:1787360132.190895:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059712 00000100:00100000:1.0:1787360132.190969:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:1.0:1787360132.190981:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+37:12409:x1874182575059712:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1787360132.191043:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.191059:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 37 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.191068:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.191100:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 37 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.191113:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 37 pid: 11098 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.191126:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596088064:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360132.195693:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360132.198819:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596088064:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360132.198831:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00010000:00010000:1.0:1787360132.198852:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360132.199076:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575059968 00000100:00100000:2.0:1787360132.199083:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575059968 00000100:00100000:2.0:1787360132.199139:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360132.199150:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:6172:x1874182575059968:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787360132.199476:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+39:6172:x1874182575059968:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 326us (648us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787360132.199484:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360132.201976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.202058:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575060096 00000100:00100000:0.0:1787360132.202067:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575060096 00010000:00010000:0.0:1787360132.202104:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 39 pid: 11098 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.202142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 96 00000100:00100000:0.0:1787360132.202151:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+39:2400:x1874182575060096:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360132.202164:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360132.202171:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 39 pid: 11098 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202184:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 39 pid: 11098 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202206:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720d37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2d9 expref: 39 pid: 11098 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202222:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.202262:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202271:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202278:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.202323:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360132.202368:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+38:2400:x1874182575060096:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 217us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.202376:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 96 00010000:00010000:3.0:1787360132.202609:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.202618:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203063:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203070:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203077:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203083:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360132.203087:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203095:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203106:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:3.0:1787360132.203109:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360132.203112:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.203118:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee720da0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.203178:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+37:12409:x1874182575059712:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 12199us (16989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360132.203186:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 212 00000100:00100000:2.0:1787360132.216158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.216301:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575060352 00000100:00100000:3.0:1787360132.216312:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575060352 00000100:00100000:3.0:1787360132.216370:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:3.0:1787360132.216397:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+37:12409:x1874182575060352:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360132.216636:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+38:12409:x1874182575060352:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 249us (487us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787360132.216644:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00010000:00010000:2.0:1787360132.218025:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360132.332097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.333863:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575060608 00000100:00100000:2.0:1787360132.333876:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575060608 00000100:00100000:0.0:1787360132.334133:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1787360132.334144:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+38:12420:x1874182575060608:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:0.0:1787360132.334168:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.334186:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720da7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef2fc expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334288:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334302:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334322:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334337:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334345:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334351:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334480:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334490:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334497:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360132.334505:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787360132.334582:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334590:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334596:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334602:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.334607:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334614:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334638:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.334642:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.334646:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334663:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334677:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334682:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334689:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334693:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.334696:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334701:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334709:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.334712:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.334714:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334719:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334774:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720da7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2fc expref: 41 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334788:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2fc expref: 40 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.334801:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.334803:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360132.334805:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:0.0:1787360132.334878:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+40:12420:x1874182575060608:12345-192.168.206.11@tcp:101:cat.0 Request processed in 736us (2791us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787360132.334886:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 213 00000100:00100000:0.0:1787360132.339944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.340092:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575060864 00000100:00100000:3.0:1787360132.340102:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575060864 00000100:00100000:3.0:1787360132.340159:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1787360132.340171:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+40:12420:x1874182575060864:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:3.0:1787360132.340506:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+41:12420:x1874182575060864:12345-192.168.206.11@tcp:35:cat.0 Request processed in 337us (570us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787360132.340514:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:1.0:1787360132.345565:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360132.345650:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360132.346037:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596088192 00000100:00100000:2.0:1787360132.346045:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596088192 00000100:00100000:2.0:1787360132.346110:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787360132.346120:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596088192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360132.346139:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1787360132.346183:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596088192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.346196:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1787360132.346250:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360132.346367:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596088320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360132.346472:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360132.346544:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596088192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360132.346812:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596088320 00000100:00100000:2.0:1787360132.346818:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596088320 00000100:00100000:2.0:1787360132.346866:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787360132.346875:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596088320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360132.346885:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00080000:0.0:1787360132.346983:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360132.347987:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596088320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1110us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.347997:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787360132.349000:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596088320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360132.364640:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.364725:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575061120 00000100:00100000:0.0:1787360132.364743:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575061120 00000100:00100000:0.0:1787360132.364795:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 214 00000100:00100000:0.0:1787360132.364805:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+41:12421:x1874182575061120:12345-192.168.206.11@tcp:36:rm.0 00010000:00010000:0.0:1787360132.364858:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787360132.364884:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720d5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e7 expref: 41 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.364908:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720dbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2fc expref: 40 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.364920:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2f5 expref: 39 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.364932:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70600/0x359a4e2aee720d4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2e0 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.364960:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.364965:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360132.364985:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.364997:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365017:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365031:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365039:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365045:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365121:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365129:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365136:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360132.365546:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:0.0:1787360132.365595:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365612:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365621:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365628:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365635:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365642:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365707:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360132.365727:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365733:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365749:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365756:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefe00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.365761:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365768:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365787:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:0.0:1787360132.365790:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787360132.365793:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365799:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefe00/0x359a4e2aee720dd8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365814:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365820:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365825:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365830:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.365833:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365838:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365844:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.365847:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.365849:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365855:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee800/0x359a4e2aee720dca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360132.365875:0:6531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c17e3c79 reply state 00000000e0d5e845 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365886:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.365891:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.365894:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360132.365896:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360132.365970:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+39:12421:x1874182575061120:12345-192.168.206.11@tcp:36:rm.0 Request processed in 1165us (1349us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787360132.365979:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 214 00010000:00010000:1.0:1787360132.368460:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360132.368473:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.368483:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360132.368488:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.368497:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.368517:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:1.0:1787360132.368520:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787360132.368526:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.368531:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee400/0x359a4e2aee720ddf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.368549:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360132.368551:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360132.368552:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360132.413631:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.413901:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575061376 00000100:00100000:3.0:1787360132.413919:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575061376 00000100:00100000:3.0:1787360132.414012:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00100000:3.0:1787360132.414025:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+39:12427:x1874182575061376:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360132.414055:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360132.414082:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720de6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef303 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414219:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414281:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414294:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414327:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414336:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.414344:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787360132.414789:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787360132.416652:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.416680:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.416692:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419176:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419199:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419207:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419215:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360132.419221:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419493:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419517:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360132.419520:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360132.419526:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419533:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720ded lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360132.419561:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5bed213 reply state 00000000a5873da6 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419575:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419583:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:3.0:1787360132.419586:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360132.419590:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787360132.419655:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720de6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 42 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419672:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 41 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.419680:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:3.0:1787360132.419683:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360132.419686:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9000, rc 0) 00000100:00100000:3.0:1787360132.419882:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+42:12427:x1874182575061376:12345-192.168.206.11@tcp:101:bash.0 Request processed in 5858us (6268us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787360132.419910:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 215 00000100:00100000:3.0:1787360132.423345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.423616:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575061504 00000100:00100000:2.0:1787360132.423629:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575061504 00000100:00100000:2.0:1787360132.423777:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:2.0:1787360132.423789:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575061504:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360132.423813:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360132.423839:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef30a expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360132.423871:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:0.0:1787360132.423918:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787360132.424045:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1787360132.424051:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360132.424064:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.424206:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.424282:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787360132.424362:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575061504:12345-192.168.206.11@tcp:101:bash.0 Request processed in 575us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.424371:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360132.427331:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.428764:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575061632 00000100:00100000:2.0:1787360132.428781:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575061632 00000100:00100000:2.0:1787360132.428902:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:2.0:1787360132.428915:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:12427:x1874182575061632:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360132.429017:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360132.429042:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef311 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.429083:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 9 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.429094:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360132.429098:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360132.429104:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.429149:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 9 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.429166:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 9 pid: 8450 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360132.429205:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1874182596088448:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360132.429524:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a136133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360132.434636:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360132.434797:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575061760 00000100:00100000:1.0:1787360132.434809:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575061760 00010000:00010000:1.0:1787360132.434883:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 10 pid: 8450 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.435069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:1.0:1787360132.435082:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+10:2400:x1874182575061760:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360132.435099:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360132.435131:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 10 pid: 8450 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.435150:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 10 pid: 8450 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.435181:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360132.435187:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360132.435198:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.435210:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.435293:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 10 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.435311:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6516:1874182596088576:192.168.206.11@tcp:105: 00010000:00010000:2.0:1787360132.435526:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee720e09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef30a expref: 10 pid: 8450 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360132.435547:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8447:1874182596088448:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360132.435581:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 9 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.435592:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697e00, rc 0) 00000100:00100000:2.0:1787360132.435646:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+9:12427:x1874182575061632:12345-192.168.206.11@tcp:101:bash.0 Request processed in 6733us (8329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.435655:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:1.0:1787360132.437372:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360132.441947:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.442144:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062016 00000100:00100000:3.0:1787360132.442159:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062016 00000100:00100000:3.0:1787360132.442279:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:3.0:1787360132.442293:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+42:12427:x1874182575062016:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:3.0:1787360132.442893:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+43:12427:x1874182575062016:12345-192.168.206.11@tcp:35:bash.0 Request processed in 602us (967us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787360132.442904:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:1.0:1787360132.443182:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6516:1874182596088576:192.168.206.11@tcp:105: 00010000:00010000:1.0:1787360132.443259:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360132.443289:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575061760:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 8210us (8669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360132.443299:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 97 00000100:00100000:3.0:1787360132.628732:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.628938:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062144 00000100:00100000:0.0:1787360132.628951:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062144 00000100:00100000:0.0:1787360132.629032:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00100000:0.0:1787360132.629045:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+43:12443:x1874182575062144:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360132.629078:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.629107:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef318 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629193:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629212:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629285:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360132.629344:0:9449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787360132.629348:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360132.629374:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629407:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef318 expref: 45 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629429:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef318 expref: 44 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.629439:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.629442:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360132.629446:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef200, rc 0) 00000100:00100000:0.0:1787360132.629530:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+44:12443:x1874182575062144:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 487us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.629538:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 216 00000100:00100000:2.0:1787360132.633153:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.633390:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062400 00000100:00100000:0.0:1787360132.633403:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062400 00000100:00100000:0.0:1787360132.633474:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 217 00000100:00100000:0.0:1787360132.633486:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+44:12443:x1874182575062400:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360132.633511:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.633539:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef31f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.633710:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.633727:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.633751:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360132.633765:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787360132.633901:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef31f expref: 47 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.633923:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef31f expref: 46 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.634206:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:0.0:1787360132.634210:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360132.634214:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:0.0:1787360132.634494:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+46:12443:x1874182575062400:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1008us (1354us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787360132.634504:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 217 00000100:00100000:2.0:1787360132.641692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.641752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.641893:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062656 00000100:00100000:3.0:1787360132.641907:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062656 00000100:00100000:3.0:1787360132.641985:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 218 00000100:00100000:3.0:1787360132.641999:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+46:12443:x1874182575062656:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360132.642029:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360132.642054:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720e3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef326 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.642187:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.642204:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.642216:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360132.642359:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787360132.642561:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720e3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef326 expref: 49 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.642582:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef326 expref: 48 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.642592:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:3.0:1787360132.642594:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787360132.642599:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9800, rc 0) 00000100:00100000:3.0:1787360132.642677:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+48:12443:x1874182575062656:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 681us (998us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1787360132.642685:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 218 00000100:00100000:3.0:1787360132.649362:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360132.649477:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062912 00000100:00100000:1.0:1787360132.649491:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062912 00000100:00100000:1.0:1787360132.649563:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1787360132.649576:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575062912:12345-192.168.206.11@tcp:1:lfs.0 00010000:00010000:1.0:1787360132.649636:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.649661:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.649671:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360132.649676:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360132.649682:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.649728:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.649755:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 8 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.649771:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1874182596088704:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360132.649900:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989029d4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360132.653474:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8448:1874182596088704:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360132.653516:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.653814:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575062784 00000100:00100000:0.0:1787360132.653824:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575062784 00000100:00100000:0.0:1787360132.653904:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1787360132.653915:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+48:2399:x1874182575062784:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360132.653933:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360132.653983:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef31f expref: 48 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.654004:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:0.0:1787360132.654010:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360132.654076:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+47:2399:x1874182575062784:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 162us (12322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.654085:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:1.0:1787360132.654362:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.654934:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063040 00000100:00100000:0.0:1787360132.654943:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063040 00002000:00100000:0.0:1787360132.654996:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff998904915c00 x1874182575063040/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:323/0 lens 504/0 e 0 to 0 dl 1787360143 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360132.655007:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904915c00 with x1874182575063040 ext(0->8) 00010000:00010000:0.0:1787360132.655017:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 9 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.655034:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 9 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360132.655042:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff998904915c00 00000100:00100000:0.0:1787360132.655074:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360132.655084:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575063040:12345-192.168.206.11@tcp:4:lfs.0 00000100:00100000:0.0:1787360132.656575:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+11:2399:x1874182575063040:12345-192.168.206.11@tcp:4:lfs.0 Request processed in 1478us (2200us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787360132.656591:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00002000:00100000:0.0:1787360132.656603:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff998904915c00 x1874182575063040/t4294967309(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:323/0 lens 504/448 e 0 to 0 dl 1787360143 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360132.656627:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998904915c00 with x1874182575063040 ext(0->8) 00010000:00010000:0.0:1787360132.656638:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.656658:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360132.656666:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff998904915c00 00000100:00100000:1.0:1787360132.660675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.660776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063168 00000100:00100000:3.0:1787360132.660791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063168 00010000:00010000:3.0:1787360132.660897:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.660946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 98 00000100:00100000:3.0:1787360132.660959:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+11:2400:x1874182575063168:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360132.660999:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787360132.661024:0:6517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787360132.661028:0:6517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787360132 00002000:00010000:3.0:1787360132.661031:0:6517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787360132 00002000:00010000:3.0:1787360132.661033:0:6517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787360132 00002000:00010000:3.0:1787360132.661036:0:6517:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787360132.661043:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.661060:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.661090:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c5cfb10/0x359a4e2aee720e10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef311 expref: 11 pid: 8447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.661108:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360132.661113:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360132.661120:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.661132:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.661213:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360132.661327:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+10:2400:x1874182575063168:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 370us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360132.661337:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 98 00010000:00010000:0.0:1787360132.661654:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661668:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661692:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661703:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661712:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661719:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360132.661724:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661754:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661769:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.661776:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9f49daf/0x359a4e2aee720e4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.661845:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2400:x1874182575062912:12345-192.168.206.11@tcp:1:lfs.0 Request processed in 12271us (12498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.661855:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1787360132.671707:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.671856:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063424 00000100:00100000:0.0:1787360132.671869:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063424 00000100:00100000:0.0:1787360132.671984:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:0.0:1787360132.671999:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20566450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+47:12443:x1874182575063424:12345-192.168.206.11@tcp:35:lfs.0 00000004:00010000:0.0:1787360132.672089:0:6535:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef326 expref: 47 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360132.672378:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1787360132.672426:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787360132.672809:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1787360132.672855:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.672874:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 51 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.672902:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.672943:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 51 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.672959:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 51 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.672975:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596088832:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360132.673203:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360132.677318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.677475:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6535:1874182596088832:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360132.677516:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.677680:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063552 00000100:00100000:3.0:1787360132.677689:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063552 00010000:00010000:3.0:1787360132.677743:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 52 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.677820:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 99 00000100:00100000:3.0:1787360132.677844:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+52:2399:x1874182575063552:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360132.677863:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360132.677871:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 52 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677885:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 52 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677911:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720dfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef303 expref: 52 pid: 6533 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677931:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:3.0:1787360132.677936:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677946:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677954:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.677985:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360132.678107:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+51:2399:x1874182575063552:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 263us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360132.678134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 99 00010000:00010000:1.0:1787360132.678190:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.678199:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360132.678372:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1787360132.678524:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787360132.678632:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596088960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787360132.678695:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360132.678731:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a02e46180 going to sleep for 11 seconds 00000100:00100000:2.0:1787360132.680280:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596088960 00000100:00100000:2.0:1787360132.680298:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596088960 00000100:00100000:2.0:1787360132.680392:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787360132.680406:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1874182596088960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787360132.680550:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6535:x1874182596088960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.680558:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1787360132.680806:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360132.680870:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596088960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787360132.681058:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1787360132.681142:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596089088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787360132.681192:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360132.681219:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360132.681528:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596089088 00000100:00100000:2.0:1787360132.681535:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596089088 00000100:00100000:2.0:1787360132.681587:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787360132.681596:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1874182596089088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787360132.681750:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6535:x1874182596089088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 154us (557us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787360132.681759:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787360132.681901:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904915180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6535:1874182596089088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787360132.681956:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787360132.681998:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682010:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682031:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682038:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360132.682043:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682051:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682071:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:1.0:1787360132.682075:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787360132.682080:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360132.682087:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720e56 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360132.682206:0:6535:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787360132.682716:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787360132.682732:0:6535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410929505396ns, next at 411929502101ns, rc = 0 00000001:00080000:1.0:1787360132.682752:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1787360132.682786:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998902718f00) 00010000:00010000:1.0:1787360132.682790:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787360132.682797:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720e41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef326 expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.683139:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20566450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+54:12443:x1874182575063424:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 11141us (11444us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787360132.683165:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000020:00080000:1.0:1787360132.683170:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787360132.685659:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.685763:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063680 00000100:00100000:0.0:1787360132.685776:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063680 00000100:00100000:0.0:1787360132.685884:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:0.0:1787360132.685897:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+54:12443:x1874182575063680:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360132.685926:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.685957:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef32d expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.686028:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef32d expref: 55 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.686069:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef32d expref: 55 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.686093:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.686096:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360132.686100:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef400, rc 0) 00000100:00100000:0.0:1787360132.686205:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+55:12443:x1874182575063680:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 311us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.686213:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 219 00000100:00100000:2.0:1787360132.689126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.691555:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575063936 00000100:00100000:3.0:1787360132.691575:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575063936 00000100:00100000:2.0:1787360132.691769:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:2.0:1787360132.691782:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+55:12443:x1874182575063936:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:2.0:1787360132.692505:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+56:12443:x1874182575063936:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 722us (3389us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787360132.692515:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1787360132.768375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.768568:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575064064 00000100:00100000:0.0:1787360132.768581:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575064064 00000100:00100000:0.0:1787360132.768662:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:0.0:1787360132.768675:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+56:12453:x1874182575064064:12345-192.168.206.11@tcp:34:lfs.0 00010000:00010000:0.0:1787360132.768783:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768804:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768819:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768832:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768839:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768866:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768962:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768970:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.768978:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360132.769035:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769050:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769056:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769064:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769070:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.769075:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769082:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769096:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.769106:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.769111:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769118:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769135:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769142:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769148:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769154:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.769157:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769163:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769171:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.769174:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.769177:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769183:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769193:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769205:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769210:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769215:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeec00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.769218:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769279:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769289:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.769291:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.769294:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.769300:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.769858:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+56:12453:x1874182575064064:12345-192.168.206.11@tcp:34:lfs.0 Request processed in 1180us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.769869:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 220 00000100:00100000:2.0:1787360132.813553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.813684:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575064320 00000100:00100000:0.0:1787360132.813699:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575064320 00000100:00100000:0.0:1787360132.813781:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:0.0:1787360132.813795:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+56:12456:x1874182575064320:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360132.813822:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.813868:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef334 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.813989:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814006:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814019:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814029:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814037:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814043:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814161:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814169:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814175:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360132.814186:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787360132.814324:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814342:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814348:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814355:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.814360:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814369:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814384:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.814387:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.814393:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814399:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720e80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814413:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814419:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814426:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814431:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.814440:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814446:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814455:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:0.0:1787360132.814457:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360132.814460:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814466:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720e87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814510:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814525:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 58 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.814533:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.814536:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360132.814538:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeea00, rc 0) 00000100:00100000:0.0:1787360132.814600:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+58:12456:x1874182575064320:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 809us (1063us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787360132.814608:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 221 00000100:00100000:2.0:1787360132.820180:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.820334:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575064448 00000100:00100000:0.0:1787360132.820359:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575064448 00000100:00100000:0.0:1787360132.820432:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:0.0:1787360132.820446:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+58:12456:x1874182575064448:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:0.0:1787360132.820557:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820581:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820595:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820639:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820647:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820655:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820661:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeec00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360132.820666:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820676:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820711:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.820715:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360132.820719:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.820726:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.820827:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+58:12456:x1874182575064448:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 384us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.820835:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 222 00000100:00100000:1.0:1787360132.825557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.825664:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575064704 00000100:00100000:3.0:1787360132.825677:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575064704 00000100:00100000:3.0:1787360132.825748:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1787360132.825759:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+58:12456:x1874182575064704:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360132.826113:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+59:12456:x1874182575064704:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 355us (570us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787360132.826122:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:1.0:1787360132.909690:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.909958:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575064960 00000100:00100000:0.0:1787360132.909971:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575064960 00000100:00100000:0.0:1787360132.910052:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:0.0:1787360132.910064:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+59:12466:x1874182575064960:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360132.910095:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360132.910099:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787360132.910133:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720e1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef318 expref: 59 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.910155:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360132.910160:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360132.910177:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720ea3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef33b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.910418:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.910435:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.910445:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.910487:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 59 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.910502:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 59 pid: 6532 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360132.910538:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089216:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360132.910750:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a136133c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360132.914966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.915304:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089216:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360132.915402:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.915476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065088 00000100:00100000:3.0:1787360132.915486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065088 00010000:00010000:3.0:1787360132.915533:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 60 pid: 6532 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360132.915580:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 100 00000100:00100000:3.0:1787360132.915596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+60:2400:x1874182575065088:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360132.915685:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360132.915694:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 60 pid: 6532 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.915707:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 60 pid: 6532 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.915745:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720e8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef334 expref: 60 pid: 6532 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.915788:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360132.915795:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.915806:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.915814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360132.916068:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360132.916282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+59:2400:x1874182575065088:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 690us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360132.916292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 100 00010000:00010000:2.0:1787360132.917755:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.917771:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360132.917797:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787360132.918033:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720ea3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 60 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.918055:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 59 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.918064:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360132.918067:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360132.918071:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696400, rc 0) 00000100:00100000:2.0:1787360132.919604:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+59:12466:x1874182575064960:12345-192.168.206.11@tcp:101:bash.0 Request processed in 9527us (9922us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787360132.919628:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 223 00000100:00100000:1.0:1787360132.924026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.924183:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065216 00000100:00100000:2.0:1787360132.924216:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065216 00000100:00100000:2.0:1787360132.927754:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:2.0:1787360132.927779:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+59:12466:x1874182575065216:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360132.927814:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360132.927842:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720eb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef342 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.927888:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.927905:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.927919:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.928197:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720eb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 61 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.928222:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 60 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.928296:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360132.928300:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360132.928304:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697a00, rc 0) 00000100:00100000:2.0:1787360132.928411:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+60:12466:x1874182575065216:12345-192.168.206.11@tcp:101:bash.0 Request processed in 641us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.928420:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 224 00000100:00100000:1.0:1787360132.932625:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.932830:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065472 00000100:00100000:0.0:1787360132.932843:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065472 00000100:00100000:0.0:1787360132.932918:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 225 00000100:00100000:0.0:1787360132.932930:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a28e52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+60:12466:x1874182575065472:12345-192.168.206.11@tcp:36:bash.0 00010000:00010000:0.0:1787360132.933278:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.933300:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.933346:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360132.933399:0:9449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787360132.933426:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089972538 reply state 00000000c727ade4 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.933441:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.933449:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.933452:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360132.933456:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360132.933578:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a28e52050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+63:12466:x1874182575065472:12345-192.168.206.11@tcp:36:bash.0 Request processed in 649us (966us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787360132.933586:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 225 00000020:00080000:0.0:1787360132.933591:0:9449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787360132.942841:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360132.942923:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065600 00000100:00100000:2.0:1787360132.942948:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065600 00000100:00100000:2.0:1787360132.943013:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00100000:2.0:1787360132.943025:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+63:12466:x1874182575065600:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:2.0:1787360132.943055:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360132.943080:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720ecd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef349 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.943185:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.943201:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 64 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.943209:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.943269:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 64 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.943283:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 64 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360132.943297:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089344:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360132.944480:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a136133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360132.949150:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089344:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360132.949203:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360132.949562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360132.950134:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065728 00000100:00100000:0.0:1787360132.950145:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065728 00010000:00010000:0.0:1787360132.950206:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 65 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360132.950291:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 101 00000100:00100000:0.0:1787360132.950304:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+65:2399:x1874182575065728:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360132.950322:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360132.950330:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 65 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950367:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 65 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950404:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696400/0x359a4e2aee720eaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef33b expref: 65 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950424:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360132.950430:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950440:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950448:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360132.950483:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360132.950540:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+64:2399:x1874182575065728:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 238us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360132.950547:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 101 00010000:00010000:2.0:1787360132.951425:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.951441:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360132.951525:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787360132.951531:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787360132.951555:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.951596:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720ecd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 64 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.951615:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 63 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360132.951624:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360132.951627:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360132.951630:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696a00, rc 0) 00000100:00100000:2.0:1787360132.951695:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+63:12466:x1874182575065600:12345-192.168.206.11@tcp:101:bash.0 Request processed in 8672us (8871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360132.951705:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 226 00000100:00100000:1.0:1787360132.957165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360132.957590:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575065984 00000100:00100000:3.0:1787360132.957603:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575065984 00000100:00100000:3.0:1787360132.958063:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:3.0:1787360132.958076:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+63:12466:x1874182575065984:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:3.0:1787360132.958545:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+64:12466:x1874182575065984:12345-192.168.206.11@tcp:35:bash.0 Request processed in 470us (1391us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1787360132.958556:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1787360133.030711:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.030842:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575066112 00000100:00100000:3.0:1787360133.030873:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575066112 00000100:00100000:3.0:1787360133.030954:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 227 00000100:00100000:3.0:1787360133.030967:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+64:12472:x1874182575066112:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360133.030996:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.031020:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef350 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031100:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031117:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031129:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360133.031184:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787360133.031188:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360133.031219:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031378:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef350 expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031401:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef350 expref: 65 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.031410:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360133.031413:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360133.031417:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9200, rc 0) 00000100:00100000:2.0:1787360133.031926:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575066112:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 959us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.031936:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 227 00000100:00100000:1.0:1787360133.035010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.035143:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575066240 00000100:00100000:3.0:1787360133.035155:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575066240 00000100:00100000:3.0:1787360133.035317:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 228 00000100:00100000:3.0:1787360133.035331:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575066240:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360133.035357:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.035392:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720ee9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef357 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035470:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035486:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035499:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035510:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035517:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035524:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035770:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035780:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035810:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360133.035869:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787360133.035874:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360133.035897:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035910:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035918:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035925:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035933:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035940:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.035945:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035953:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035966:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360133.035969:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.035974:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.035991:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720ef0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036009:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036016:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036022:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036027:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.036030:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036036:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036044:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:3.0:1787360133.036046:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.036049:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036055:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720ef7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036085:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720ee9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036111:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 66 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.036191:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.036194:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360133.036196:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9800, rc 0) 00000100:00100000:3.0:1787360133.036422:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+66:12472:x1874182575066240:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 1093us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.036431:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 228 00000100:00100000:1.0:1787360133.040005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360133.040097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.040176:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575066624 00000100:00100000:3.0:1787360133.040188:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575066624 00000100:00100000:3.0:1787360133.040280:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:3.0:1787360133.040292:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+66:12472:x1874182575066624:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360133.040317:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.040342:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef35e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040477:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040494:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040503:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040533:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040573:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040587:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.040602:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089472:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360133.040724:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.040743:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 67 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.040752:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089600:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360133.040774:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360133.043424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00010000:00010000:3.0:1787360133.043501:0:6531:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.11@tcp) returned -22 from blocking AST (req@000000000aff8c9d x1874182596089472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.043526:0:6531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.043555:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720efe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef357 expref: 67 pid: 11098 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.043594:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089472:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360133.043623:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1874182596089600:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360133.043653:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.043660:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.043670:0:6531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.043681:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.044071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575066368 00000100:00100000:2.0:1787360133.044080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575066368 00000100:00100000:2.0:1787360133.044150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575066752 00000100:00100000:2.0:1787360133.044154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575066752 00010000:00010000:2.0:1787360133.044169:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 68 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.044207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:2.0:1787360133.044369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+68:2400:x1874182575066752:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360133.044399:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360133.044406:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 68 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044428:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 68 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044444:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720ed4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef349 expref: 68 pid: 6531 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044457:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360133.044462:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044471:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044478:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.044503:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360133.044561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+67:2400:x1874182575066752:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 196us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.044845:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:0.0:1787360133.044858:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+67:2399:x1874182575066368:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360133.044868:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360133.044871:0:7474:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 359a4e2aee720efe) 00010000:00010000:0.0:1787360133.044872:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360133.044893:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+67:2399:x1874182575066368:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 40us (4901us total) trans 0 rc 116/116 00000100:00100000:0.0:1787360133.044911:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00010000:00010000:3.0:1787360133.045077:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.045087:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360133.045109:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787360133.045357:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 68 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.045444:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 67 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.045454:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.045457:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787360133.045467:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8a00, rc 0) 00000100:00100000:3.0:1787360133.045499:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+67:12472:x1874182575066624:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 5209us (5401us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787360133.045507:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 229 00000100:00100000:2.0:1787360133.047953:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 102 00000100:00100000:0.0:1787360133.048599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.048832:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067008 00000100:00100000:2.0:1787360133.049597:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067008 00000100:00100000:2.0:1787360133.049798:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1787360133.049811:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+66:12472:x1874182575067008:12345-192.168.206.11@tcp:103:lfs.0 00010000:00010000:2.0:1787360133.049849:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360133.049882:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720e5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef32d expref: 66 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.049906:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360133.049912:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360133.049988:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575067008:12345-192.168.206.11@tcp:103:lfs.0 Request processed in 179us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.049997:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360133.052216:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.052508:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067136 00000100:00100000:3.0:1787360133.052522:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067136 00000100:00100000:3.0:1787360133.052600:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00100000:3.0:1787360133.052721:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575067136:12345-192.168.206.11@tcp:58:lfs.0 00010000:00010000:3.0:1787360133.052977:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.052999:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.053013:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360133.053138:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787360133.053477:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575067136:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 864us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.053488:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 230 00000100:00100000:1.0:1787360133.059721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.059934:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067264 00000100:00100000:3.0:1787360133.059948:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067264 00000100:00100000:3.0:1787360133.060022:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 231 00000100:00100000:3.0:1787360133.060035:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+65:12472:x1874182575067264:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360133.060060:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.060087:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef365 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060179:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060192:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 66 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060215:0:11098:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060340:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 66 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060356:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.060360:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360133.060365:0:11098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 66 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.060375:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8600, rc 0) 00000100:00100000:3.0:1787360133.060717:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+66:12472:x1874182575067264:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 683us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.060726:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 231 00010000:00010000:2.0:1787360133.241553:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360133.689533:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360133.689545:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360133.689605:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787360133.689619:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360133.689799:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596089728:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360133.689994:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360133.702996:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596089728:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360133.706212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.706960:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067392 00000100:00100000:3.0:1787360133.706975:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067392 00000100:00100000:3.0:1787360133.707051:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 232 00000100:00100000:3.0:1787360133.707063:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+66:12473:x1874182575067392:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787360133.707104:0:6531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787360133.707886:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+66:12473:x1874182575067392:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 271us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.707901:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 232 00000100:00100000:1.0:1787360133.715690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.715832:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067520 00000100:00100000:3.0:1787360133.715844:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067520 00000100:00100000:3.0:1787360133.715921:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:3.0:1787360133.715934:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+66:12473:x1874182575067520:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787360133.716027:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716047:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716061:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716079:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716086:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716093:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716126:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716137:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716143:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360133.716271:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787360133.716277:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360133.716294:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716307:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716314:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716321:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.716327:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.717146:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717163:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717184:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360133.717187:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.717191:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717197:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee720f28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717504:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717531:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717537:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717542:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.717545:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717551:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717560:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff998902718900) 00010000:00010000:3.0:1787360133.717562:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.717565:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717571:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee720f2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717591:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717597:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717602:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717607:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.717615:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717621:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717630:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.717632:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.717636:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.717641:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.718495:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+66:12473:x1874182575067520:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 2552us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.718509:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 233 00000100:00100000:1.0:1787360133.728776:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.728960:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067776 00000100:00100000:3.0:1787360133.728975:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067776 00000100:00100000:3.0:1787360133.729087:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:3.0:1787360133.729099:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+66:12473:x1874182575067776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360133.729125:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.729149:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720f3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef36c expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729303:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729321:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729364:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360133.729385:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787360133.729482:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729490:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729497:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729503:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.729508:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729516:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729530:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360133.729533:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360133.729538:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729544:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee720f44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729593:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720f3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef36c expref: 68 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729630:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:3.0:1787360133.729632:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360133.729637:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee720f3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef36c expref: 68 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.729649:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9000, rc 0) 00000100:00100000:3.0:1787360133.729812:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575067776:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 715us (1050us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1787360133.729821:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 234 00000100:00100000:2.0:1787360133.736981:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.737068:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575067904 00000100:00100000:0.0:1787360133.737080:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575067904 00000100:00100000:0.0:1787360133.737148:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00100000:0.0:1787360133.737159:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575067904:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787360133.737204:0:9449:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787360133.737534:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575067904:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 375us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.737543:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 235 00000100:00100000:1.0:1787360133.742167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.742451:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575068160 00000100:00100000:3.0:1787360133.742464:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575068160 00000100:00100000:3.0:1787360133.742525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 236 00000100:00100000:3.0:1787360133.742537:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575068160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360133.742561:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360133.742565:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787360133.742596:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef350 expref: 67 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.742621:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:3.0:1787360133.742626:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360133.742639:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef373 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360133.746942:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787360133.747127:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720f59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.747146:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.747159:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720f59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.747266:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8800/0x359a4e2aee720f52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef373 expref: 69 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.747290:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720f59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef373 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.747301:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a02ef1300) 00010000:00010000:2.0:1787360133.747321:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360133.747325:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697400, rc 0) 00000100:00100000:2.0:1787360133.747628:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+68:12473:x1874182575068160:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 5091us (5473us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787360133.747637:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 236 00000100:00100000:2.0:1787360133.756621:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.766331:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575068416 00000100:00100000:3.0:1787360133.766346:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575068416 00000100:00100000:2.0:1787360133.767051:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 237 00000100:00100000:2.0:1787360133.767065:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+68:12473:x1874182575068416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360133.767126:0:11098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360133.767155:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697400/0x359a4e2aee720f59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef373 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767175:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a02ef1300) 00010000:00010000:2.0:1787360133.767184:0:11098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360133.767201:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767215:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767223:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767301:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767310:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767317:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767386:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767394:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767400:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767406:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360133.767410:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767418:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767427:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360133.767429:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360133.767433:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767438:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696000/0x359a4e2aee720f67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767447:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767453:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767459:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767469:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360133.767473:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767479:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767487:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xae654fa2 (ffff998a02ef1000) 00010000:00010000:2.0:1787360133.767490:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360133.767493:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.767499:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae654fa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.767581:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575068416:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 519us (10969us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360133.767589:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 237 00000100:00100000:1.0:1787360133.769871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.770017:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575068544 00000100:00100000:0.0:1787360133.770025:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575068544 00000100:00100000:0.0:1787360133.770111:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 238 00000100:00100000:0.0:1787360133.770122:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+67:12473:x1874182575068544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360133.770140:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360133.770161:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720f75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef37a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770206:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770217:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770252:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770339:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720f75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 69 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770355:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 68 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.770372:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.770374:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360133.770377:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef800, rc 0) 00000100:00100000:0.0:1787360133.770420:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+68:12473:x1874182575068544:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 302us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.770427:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 238 00000100:00100000:3.0:1787360133.778424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.778515:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575068800 00000100:00100000:2.0:1787360133.778530:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575068800 00000100:00100000:2.0:1787360133.778599:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:2.0:1787360133.778610:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+68:12473:x1874182575068800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360133.778688:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.778706:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.778717:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360133.778895:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787360133.778905:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412025678730ns, next at 413025676068ns, rc = 0 00000004:00010000:2.0:1787360133.778953:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0b28828 reply state 00000000c29cc567 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.778966:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.778973:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:2.0:1787360133.778976:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787360133.778979:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360133.779168:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+70:12473:x1874182575068800:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 559us (760us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787360133.779175:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 239 00000100:00100000:2.0:1787360133.782216:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.782278:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575068928 00000100:00100000:0.0:1787360133.782287:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575068928 00000100:00100000:1.0:1787360133.782782:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00100000:1.0:1787360133.782795:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+70:12473:x1874182575068928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360133.782815:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360133.782847:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef381 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.782912:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 71 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.782926:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 71 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.782944:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:1.0:1787360133.782947:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360133.782950:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71600, rc 0) 00000100:00100000:1.0:1787360133.783008:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+71:12473:x1874182575068928:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 216us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360133.783014:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 240 00000100:00100000:2.0:1787360133.797431:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.797610:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575069056 00000100:00100000:0.0:1787360133.797681:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575069056 00000100:00100000:0.0:1787360133.797762:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:0.0:1787360133.797772:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575069056:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787360133.798127:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+10:2399:x1874182575069056:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 355us (702us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787360133.798135:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00080000:1.0:1787360133.798202:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360133.810356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.810458:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575069312 00000100:00100000:3.0:1787360133.810468:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575069312 00000100:00100000:3.0:1787360133.810533:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360133.810544:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+71:12473:x1874182575069312:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360133.810780:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+72:12473:x1874182575069312:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 238us (432us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787360133.810788:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:2.0:1787360133.820352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360133.820453:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575069568 00000100:00100000:1.0:1787360133.820465:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575069568 00000100:00100000:1.0:1787360133.820531:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:1.0:1787360133.820541:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+72:12473:x1874182575069568:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787360133.820659:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+72:12473:x1874182575069568:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360133.820668:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 241 00000100:00100000:1.0:1787360133.823202:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.823379:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575069696 00000100:00100000:0.0:1787360133.823392:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575069696 00000100:00100000:0.0:1787360133.823461:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:0.0:1787360133.823481:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+72:12473:x1874182575069696:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360133.823499:0:9449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360133.823519:0:9449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720f91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef388 expref: -99 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823580:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823593:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823603:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360133.823657:0:9449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360133.823677:0:9449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823701:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef400/0x359a4e2aee720f91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef388 expref: 74 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823718:0:9449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef388 expref: 73 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.823755:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.823758:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360133.823761:0:9449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefc00, rc 0) 00000100:00100000:0.0:1787360133.824042:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+73:12473:x1874182575069696:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 570us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.824050:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 242 00000100:00100000:3.0:1787360133.831427:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.831638:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575069824 00000100:00100000:2.0:1787360133.831648:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575069824 00000100:00100000:2.0:1787360133.831723:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360133.831744:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+10:2400:x1874182575069824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360133.831760:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360133.831780:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef38f expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360133.831808:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f385, blocks: 0x0 00010000:00010000:2.0:1787360133.831839:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1787360133.831844:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360133.831853:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.831871:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.831885:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697200, rc 0) 00000100:00100000:2.0:1787360133.832347:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+11:2400:x1874182575069824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 604us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.832354:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360133.835531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360133.835751:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070080 00000100:00100000:1.0:1787360133.835760:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070080 00000100:00100000:1.0:1787360133.835860:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:1.0:1787360133.835871:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+73:12473:x1874182575070080:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787360133.835996:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+73:12473:x1874182575070080:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 126us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360133.836004:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 243 00000100:00100000:1.0:1787360133.845390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.845574:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070208 00000100:00100000:2.0:1787360133.845584:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070208 00000100:00100000:2.0:1787360133.845685:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:2.0:1787360133.845696:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+11:12473:x1874182575070208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360133.845713:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360133.845739:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef396 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.845772:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.845782:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360133.845787:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360133.845806:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.845842:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.845856:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.845881:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1874182596089856:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360133.846348:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1068a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360133.850839:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8447:1874182596089856:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360133.850875:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 12 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.850894:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697e00, rc 0) 00000100:00100000:2.0:1787360133.851882:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+12:12473:x1874182575070208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 6183us (6561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.851893:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:1.0:1787360133.860567:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.863459:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070336 00000100:00100000:3.0:1787360133.863479:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070336 00010000:00010000:3.0:1787360133.863546:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.863605:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:3.0:1787360133.863616:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+12:2400:x1874182575070336:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360133.863637:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360133.863663:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.863680:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.863705:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004026a783/0x359a4e2aee720f9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef38f expref: 12 pid: 8450 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.863758:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360133.863763:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360133.863772:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.863782:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.863829:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 11 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.863845:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6518:1874182596089984:192.168.206.11@tcp:105: 00000100:00100000:3.0:1787360133.863947:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27240 going to sleep for 11 seconds 00000100:00100000:3.0:1787360133.872012:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.872129:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070464 00000100:00100000:0.0:1787360133.872209:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070464 00000100:00100000:1.0:1787360133.872381:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6518:1874182596089984:192.168.206.11@tcp:105: 00010000:00010000:1.0:1787360133.872405:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1787360133.872554:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff99890492e300 x1874182575070464/t0(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:324/0 lens 504/0 e 0 to 0 dl 1787360144 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360133.872565:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99890492e300 with x1874182575070464 ext(0->12) 00002000:00010000:0.0:1787360133.872571:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99890492e300 00000100:00100000:0.0:1787360133.872605:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:0.0:1787360133.872614:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+12:2400:x1874182575070464:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787360133.873432:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1121de3d-8714-4863-bc5d-127112ba378a+14:2400:x1874182575070336:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 9813us (12871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360133.873443:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 103 00000100:00100000:0.0:1787360133.877414:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1121de3d-8714-4863-bc5d-127112ba378a+13:2400:x1874182575070464:12345-192.168.206.11@tcp:4:lhsmtool_posix.0 Request processed in 4790us (5405us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787360133.877429:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00002000:00100000:0.0:1787360133.877442:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff99890492e300 x1874182575070464/t4294967321(0) o4->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:324/0 lens 504/448 e 0 to 0 dl 1787360144 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360133.877453:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99890492e300 with x1874182575070464 ext(0->12) 00002000:00010000:0.0:1787360133.877459:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99890492e300 00000100:00100000:2.0:1787360133.882309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.883254:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070592 00000100:00100000:0.0:1787360133.883265:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070592 00000100:00100000:0.0:1787360133.883380:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:0.0:1787360133.883391:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+73:12473:x1874182575070592:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787360133.885754:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787360133.885777:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787360133.885819:0:6511:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787360133.885846:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99890294c000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787360133.885852:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07e58b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99890294c3c0 00000020:00080000:0.0:1787360133.885856:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07e58300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998a1a713a00 00000020:00080000:0.0:1787360133.885919:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998903a323c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787360133.885923:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07e58700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998903a32c00 00000020:00080000:0.0:1787360133.885927:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a07e58c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff998a051c8000 00000020:00080000:1.0:1787360133.885994:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787360133.886053:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787360133.886075:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596090112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787360133.886164:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360133.886173:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:12473:x1874182575070592:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 2775us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.886202:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 244 00000100:00100000:1.0:1787360133.886257:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596090240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787360133.886285:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360133.886325:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886347:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886357:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886363:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.886369:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886406:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886427:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff998a28ed0600) 00010000:00010000:3.0:1787360133.886430:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.886436:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886444:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720cab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.886462:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596090112 00000100:00100000:1.0:1787360133.886470:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596090112 00010000:00010000:3.0:1787360133.886486:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886496:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886502:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886509:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefa00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.886513:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.886515:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596090240 00000100:00100000:1.0:1787360133.886520:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596090240 00010000:00010000:3.0:1787360133.886525:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886538:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff998a029e8a00) 00010000:00010000:3.0:1787360133.886541:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.886546:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.886546:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787360133.886560:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3661:x1874182596090112:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787360133.886581:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefa00/0x359a4e2aee720d53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787360133.886597:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1787360133.886604:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886612:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886619:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.886624:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886626:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.886631:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886660:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886672:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:3.0:1787360133.886686:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.886691:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886701:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee200/0x359a4e2aee720dd1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.886702:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 12 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.886743:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787360133.886748:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360133.886753:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886762:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886771:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886789:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.886790:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 12 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886814:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.886821:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.886830:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 12 pid: 8770 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886832:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886863:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998a029e8400) 00010000:00010000:3.0:1787360133.886871:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787360133.886871:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596090368:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360133.886877:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886887:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720df4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886908:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886915:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886921:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886927:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.886931:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.886934:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1787360133.886951:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.886964:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00000100:00100000:1.0:1787360133.886968:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1787360133.886970:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360133.886976:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.886984:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596090240:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787360133.886987:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef200/0x359a4e2aee720ec6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887009:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887016:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887022:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887028:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.887030:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887036:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887045:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:3.0:1787360133.887048:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360133.887051:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.887067:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696a00/0x359a4e2aee720f83 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360133.887081:0:8770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787360133.887087:0:8770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787360133 00002000:00010000:1.0:1787360133.887089:0:8770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787360133.887092:0:8770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787360133 -> 1787360133 00002000:00010000:1.0:1787360133.887095:0:8770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1787360133.887518:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3658:x1874182596090240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 538us (1230us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787360133.887536:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787360133.889840:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596090496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787360133.889921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360133.890006:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596090496 00000100:00100000:2.0:1787360133.890020:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596090496 00000100:00100000:2.0:1787360133.890083:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360133.890096:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3659:x1874182596090496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787360133.890146:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1787360133.890532:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a88f384, atime: 0x6a88f384, ctime: 0x6a88f384, blocks: 0x8 00010000:00010000:2.0:1787360133.890558:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.890579:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1787360133.890583:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360133.890590:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.890609:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.890619:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.890628:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.890649:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787360133.890889:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3659:x1874182596090496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 795us (966us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787360133.890898:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1787360133.891959:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99890432a300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787360133.891971:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596090496:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787360133.893802:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360133.893814:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.893829:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360133.893834:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.893845:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.893894:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.893902:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9471538/0x359a4e2aee720fb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.893925:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360133.893927:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360133.893929:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787360133.897302:0:3658:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998a3ff47480/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787360133.897317:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596090240:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1787360133.897591:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1787360133.897601:0:9528:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1787360133.906550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.906591:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.906662:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070720 00000100:00100000:0.0:1787360133.906671:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070720 00000100:00100000:0.0:1787360133.906724:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 76 00000100:00100000:0.0:1787360133.906744:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3536b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+13:2399:x1874182575070720:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787360133.907705:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575070848 00000100:00100000:3.0:1787360133.907713:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575070848 00010000:00010000:3.0:1787360133.907755:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 14 pid: 8770 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.907799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 104 00000100:00100000:3.0:1787360133.907808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:2399:x1874182575070848:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360133.907820:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360133.907826:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 14 pid: 8770 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.907841:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 14 pid: 8770 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.907865:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360133.907870:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360133.907884:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.907895:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.907917:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360133.907985:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+14:2399:x1874182575070848:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 177us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.907994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 104 00010000:00010000:1.0:1787360133.908932:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060ebd3e2/0x359a4e2aee720d61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2ee expref: 13 pid: 8770 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.908952:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596090368:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360133.908980:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.908990:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.908998:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.909009:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.909017:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.909094:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360133.909297:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3661:x1874182596090112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22737us (23132us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787360133.909306:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:3.0:1787360133.909653:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998a3ff46a00/2, rc 0, transno 4294967323 00000100:00100000:3.0:1787360133.909660:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596090112:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787360133.909792:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00080000:0.0:1787360133.909792:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:2.0:1787360133.909805:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360133.909810:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00010000:00010000:2.0:1787360133.909826:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360133.909832:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.909842:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.909960:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3536b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575070720:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 3217us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.909968:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 76 00010000:00010000:2.0:1787360133.910619:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.910631:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee720fad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.910651:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360133.910653:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360133.910654:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360133.915788:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.915936:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071104 00000100:00100000:0.0:1787360133.915946:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071104 00000100:00100000:0.0:1787360133.916007:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:0.0:1787360133.916017:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+21:12473:x1874182575071104:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787360133.916067:0:9449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360133.916092:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caefc00/0x359a4e2aee720f98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef388 expref: 21 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.916141:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.916147:0:9449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360133.916174:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.916188:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.916197:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360133.916353:0:9449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5bed213 reply state 000000009e46de83 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.916365:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.916371:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.916374:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787360133.916376:0:9449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360133.916451:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+22:12473:x1874182575071104:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 435us (672us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1787360133.916458:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 245 00000100:00100000:3.0:1787360133.918633:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.918708:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071232 00000100:00100000:2.0:1787360133.918722:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071232 00000100:00100000:2.0:1787360133.918798:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:2.0:1787360133.918809:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575071232:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787360133.918957:0:8447:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787360133.918961:0:8447:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787360133 -> 1787360132 00002000:00010000:2.0:1787360133.918964:0:8447:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787360132 00002000:00010000:2.0:1787360133.918966:0:8447:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787360133 -> 1787360132 00002000:00010000:2.0:1787360133.918980:0:8447:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787360133.919047:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575071232:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 239us (429us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787360133.919055:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 77 00000100:00100000:3.0:1787360133.921559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360133.921647:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071488 00000100:00100000:1.0:1787360133.921660:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071488 00000100:00100000:1.0:1787360133.921723:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:1.0:1787360133.921744:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+22:12473:x1874182575071488:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787360133.921806:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.921824:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.921834:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.921868:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360133.921892:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 22 pid: 6532 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360133.921906:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596090624:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360133.921983:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff99890294cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360133.926673:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596090624:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360133.926702:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.927541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.927618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071616 00000100:00100000:2.0:1787360133.927628:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071616 00010000:00010000:2.0:1787360133.927668:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 23 pid: 6532 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.927711:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 105 00000100:00100000:2.0:1787360133.927721:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+23:2399:x1874182575071616:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360133.927745:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360133.927752:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 23 pid: 6532 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927765:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 23 pid: 6532 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927787:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef800/0x359a4e2aee720f7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef37a expref: 23 pid: 6532 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927802:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:2.0:1787360133.927807:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927829:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927836:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.927865:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360133.928028:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575071616:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 307us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.928037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 105 00010000:00010000:3.0:1787360133.928428:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928443:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928494:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928503:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928511:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928518:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360133.928523:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928548:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928566:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:3.0:1787360133.928570:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787360133.928575:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.928581:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70a00/0x359a4e2aee720fc2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.928658:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+21:12473:x1874182575071488:12345-192.168.206.11@tcp:55:lhsmtool_posix.0 Request processed in 6914us (7108us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787360133.928668:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 246 00000100:00100000:1.0:1787360133.935147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.935307:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071744 00000100:00100000:0.0:1787360133.935317:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071744 00000100:00100000:0.0:1787360133.935369:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:0.0:1787360133.935379:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575071744:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787360133.935419:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.935451:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.935459:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360133.935463:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360133.935467:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.935514:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 8 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.935531:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 8 pid: 8447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360133.935547:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596090752:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360133.935632:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360133.939611:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.939688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575071872 00000100:00100000:3.0:1787360133.939704:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575071872 00000100:00100000:0.0:1787360133.939725:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8448:1874182596090752:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360133.939765:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.939773:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 9 pid: 8447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.939830:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 106 00000100:00100000:3.0:1787360133.939842:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+9:2399:x1874182575071872:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360133.939860:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360133.939888:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 9 pid: 8447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.939905:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 9 pid: 8447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.939957:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c5cfb10/0x359a4e2aee720fa6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef396 expref: 9 pid: 8447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.939978:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360133.939984:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360133.939990:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.940002:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360133.940038:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360133.940109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575071872:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 269us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.940118:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 106 00010000:00010000:0.0:1787360133.940159:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940171:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940213:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940222:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940274:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940282:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caefc00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360133.940287:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940297:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940314:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.940322:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029af4c98/0x359a4e2aee720fc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360133.940393:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+7:2400:x1874182575071744:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 5014us (5267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.940403:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 78 00000100:00100000:3.0:1787360133.942773:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.942852:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575072128 00000100:00100000:0.0:1787360133.942865:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575072128 00000100:00100000:0.0:1787360133.943037:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 247 00000100:00100000:0.0:1787360133.943048:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+21:12473:x1874182575072128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787360133.943126:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.943157:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.943168:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.943201:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.943215:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 21 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360133.943262:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596090880:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360133.943342:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cb8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360133.946120:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596090880:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360133.946163:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360133.949278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360133.949365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575072256 00000100:00100000:2.0:1787360133.949377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575072256 00010000:00010000:2.0:1787360133.949421:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.949468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 107 00000100:00100000:2.0:1787360133.949478:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+22:2400:x1874182575072256:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360133.949493:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360133.949500:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949513:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949535:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697a00/0x359a4e2aee720ebf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef342 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949614:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360133.949626:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949637:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949645:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949652:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949680:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360133.949746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+21:2400:x1874182575072256:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 269us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360133.949753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 107 00010000:00010000:2.0:1787360133.949806:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949814:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949975:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.949987:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.950009:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.950038:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 21 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.950050:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 21 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.950064:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596091008:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360133.950117:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1068a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360133.958996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360133.959089:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575072384 00000100:00100000:0.0:1787360133.959097:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575072384 00010000:00010000:0.0:1787360133.959133:0:7474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360133.959196:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 108 00000100:00100000:0.0:1787360133.959207:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575072384:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360133.959221:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360133.959261:0:7474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.959274:0:7474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 22 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.959296:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.959300:0:7474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.959309:0:7474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.959317:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.959335:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360133.959378:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+22:2399:x1874182575072384:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 174us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360133.959385:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 108 00010000:00010000:2.0:1787360133.961801:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee720f8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef381 expref: 21 pid: 11098 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360133.961825:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596091008:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360133.961847:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.961856:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360133.961861:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360133.961963:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787360133.962074:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787360133.962106:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787360133.962200:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596091136:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787360133.962282:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360133.962416:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a670a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360133.964383:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596091136 00000100:00100000:1.0:1787360133.964395:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596091136 00000100:00100000:1.0:1787360133.964505:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787360133.964516:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0fed2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1874182596091136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360133.964695:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0fed2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1874182596091136:12345-0@lo:1000:mdt00_002.0 Request processed in 181us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360133.964703:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787360133.968368:0:6533:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787360133.968380:0:6533:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1787360133.968400:0:6533:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998a3ff47480, transno 4294967322 00000100:00100000:0.0:1787360133.968434:0:6533:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff998a3ff46a00 x1874182596090112/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787360149 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360133.968462:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596091136:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787360133.968618:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1787360133.968693:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596091264:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787360133.968800:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360133.976280:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596091264 00000100:00100000:2.0:1787360133.976295:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596091264 00000100:00100000:0.0:1787360133.976315:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1068ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360133.984707:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787360133.984743:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6533:x1874182596091264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360133.984925:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6533:x1874182596091264:12345-0@lo:1000:mdt00_002.0 Request processed in 206us (16124us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787360133.984933:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787360133.985042:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1874182596091264:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787360133.985090:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985100:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985107:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985113:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360133.985117:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985124:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985140:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:0.0:1787360133.985143:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360133.985147:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985152:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697200/0x359a4e2aee720fd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985194:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985200:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985205:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985209:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360133.985212:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985217:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985242:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360133.985245:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360133.985251:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 24 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985261:0:6533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 24 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985269:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 24 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.985298:0:6533:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 24 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360133.985326:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596091392:192.168.206.11@tcp:105: 00000100:00100000:0.0:1787360133.985395:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a50e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360133.998586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360133.998669:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575072512 00000100:00100000:3.0:1787360133.998757:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575072512 00000100:00100000:3.0:1787360133.999626:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1787360133.999640:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:12472:x1874182575072512:12345-192.168.206.11@tcp:49:lfs.0 00000100:00100000:3.0:1787360133.999781:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+25:12472:x1874182575072512:12345-192.168.206.11@tcp:49:lfs.0 Request processed in 145us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360133.999789:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:0.0:1787360133.999900:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1874182596091392:192.168.206.11@tcp:105: 00010000:00010000:0.0:1787360133.999926:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.999936:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9800/0x359a4e2aee720f1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.999969:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.999982:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360133.999993:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000001:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000007:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000013:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000018:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360134.000022:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000037:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000049:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360134.000052:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360134.000056:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000062:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caee000/0x359a4e2aee720fde lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000072:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000078:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000083:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000087:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeea00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360134.000090:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000095:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000101:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360134.000103:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360134.000106:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.000122:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeea00/0x359a4e2aee720fd0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360134.000307:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360134.000312:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360134.000802:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787360134.000812:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360134.000894:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+24:12473:x1874182575072128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 57846us (58128us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787360134.000904:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 247 00000020:00080000:0.0:1787360134.000909:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787360134.008334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360134.008417:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575072768 00000100:00100000:1.0:1787360134.008426:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575072768 00000100:00100000:1.0:1787360134.008499:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00100000:1.0:1787360134.008509:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:12472:x1874182575072768:12345-192.168.206.11@tcp:58:lfs.0 00000040:00080000:1.0:1787360134.008658:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787360134.008746:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+24:12472:x1874182575072768:12345-192.168.206.11@tcp:58:lfs.0 Request processed in 238us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360134.008754:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 248 00000100:00080000:0.0:1787360134.008860:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360134.011726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360134.012495:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073024 00000100:00100000:2.0:1787360134.012505:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073024 00000100:00100000:2.0:1787360134.012566:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:2.0:1787360134.012576:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20566850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+24:12473:x1874182575073024:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787360134.012838:0:6534:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787360134.012870:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1787360134.012901:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012916:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012928:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012936:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012942:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012949:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.012974:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787360134.013068:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20566850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+26:12473:x1874182575073024:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 493us (1350us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787360134.013076:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000020:00080000:2.0:1787360134.013081:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787360134.013264:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360134.013271:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360134.013280:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360134.013284:0:7473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360134.013307:0:7473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360134.013320:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:1.0:1787360134.013323:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787360134.013327:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360134.013333:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22696200/0x359a4e2aee720fe5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360134.013345:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360134.013347:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360134.013349:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360134.054994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360134.055089:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073152 00000100:00100000:3.0:1787360134.055100:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073152 00000100:00100000:3.0:1787360134.055170:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 249 00000100:00100000:3.0:1787360134.055180:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+26:12475:x1874182575073152:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360134.055203:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360134.055257:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720fec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef39d expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055319:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055333:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055343:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055356:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055362:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055369:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055428:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055437:0:11098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055463:0:11098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055494:0:11098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 27 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360134.055507:0:11098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 27 pid: 6531 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360134.055520:0:11098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596091520:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360134.055627:0:11098:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef27000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360134.058968:0:11098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11098:1874182596091520:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360134.059002:0:11098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360134.059876:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360134.059958:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073408 00000100:00100000:3.0:1787360134.059965:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073408 00000100:00100000:3.0:1787360134.060019:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:3.0:1787360134.060029:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+28:6172:x1874182575073408:12345-192.168.206.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787360134.060303:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:6172:x1874182575073408:12345-192.168.206.11@tcp:35:ldlm_bl.0 Request processed in 275us (429us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787360134.060310:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:0.0:1787360134.065390:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360134.065484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073536 00000100:00100000:2.0:1787360134.065494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073536 00010000:00010000:2.0:1787360134.065542:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 29 pid: 6531 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360134.065581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 109 00000100:00100000:2.0:1787360134.065592:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+29:2400:x1874182575073536:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360134.065605:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360134.065613:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 29 pid: 6531 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065625:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 29 pid: 6531 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065646:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8a00/0x359a4e2aee720f0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef35e expref: 29 pid: 6531 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065661:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360134.065666:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065674:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065694:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360134.065740:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360134.065800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1121de3d-8714-4863-bc5d-127112ba378a+28:2400:x1874182575073536:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 209us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360134.065807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 109 00010000:00010000:0.0:1787360134.066047:0:11098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066056:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360134.066104:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787360134.066108:0:11098:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360134.066126:0:11098:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066138:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066147:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066164:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066171:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066177:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360134.066181:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066189:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066199:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:0.0:1787360134.066201:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360134.066205:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066210:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9c00/0x359a4e2aee720ff3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066223:0:11098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066279:0:11098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066284:0:11098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066289:0:11098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360134.066299:0:11098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066305:0:11098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066314:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff998902718900) 00010000:00010000:0.0:1787360134.066316:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360134.066319:0:11098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066325:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9200/0x359a4e2aee720ffa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066359:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8400/0x359a4e2aee720fec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef39d expref: 28 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066374:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef39d expref: 27 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360134.066381:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360134.066383:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360134.066386:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9000, rc 0) 00000100:00100000:0.0:1787360134.066423:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+27:12475:x1874182575073152:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 11244us (11439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360134.066430:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 249 00010000:00010000:0.0:1787360134.265521:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360134.393559:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596091648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360134.393634:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360134.393899:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596091648 00000100:00100000:2.0:1787360134.393908:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596091648 00000100:00100000:2.0:1787360134.393960:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787360134.393970:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596091648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360134.394002:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787360134.394053:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596091648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360134.394059:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787360134.394320:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596091648:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787360134.833048:0:14771:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360134.833060:0:14771:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360134.833096:0:14771:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787360134.833101:0:14771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360135.019388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360135.021074:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073664 00000100:00100000:1.0:1787360135.021088:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073664 00000100:00100000:1.0:1787360135.021165:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 393 00000100:00100000:1.0:1787360135.021176:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575073664:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360135.021288:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2400:x1874182575073664:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 112us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360135.021295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 393 00000100:00100000:2.0:1787360135.027458:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360135.027486:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360135.027686:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360135.027876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360135.028150:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073792 00000100:00100000:0.0:1787360135.028159:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073792 00000100:00100000:0.0:1787360135.028209:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575073920 00000100:00100000:0.0:1787360135.028212:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575073920 00000100:00100000:0.0:1787360135.028269:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 338 00000100:00100000:0.0:1787360135.028279:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:2400:x1874182575073792:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360135.028289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360135.028323:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360135.028359:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:2400:x1874182575073792:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 81us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360135.028367:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 338 00000100:00100000:0.0:1787360135.028385:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074304 00000100:00100000:0.0:1787360135.028388:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074304 00000100:00100000:0.0:1787360135.028406:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074432 00000100:00100000:0.0:1787360135.028409:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074432 00000100:00100000:0.0:1787360135.028425:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 339 00000100:00100000:0.0:1787360135.028444:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575073920:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360135.028471:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575073920:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360135.028477:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 339 00000100:00100000:0.0:1787360135.028492:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 340 00000100:00100000:0.0:1787360135.028498:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575074304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360135.028526:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575074304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.028532:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074048 00000100:00100000:0.0:1787360135.028533:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 340 00000100:00100000:0.0:1787360135.028550:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 341 00000100:00100000:3.0:1787360135.028551:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074048 00000100:00100000:0.0:1787360135.028560:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575074432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360135.028589:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074176 00000100:00100000:3.0:1787360135.028594:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074176 00000100:00100000:0.0:1787360135.028601:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575074432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.028615:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1787360135.028619:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 341 00000100:00100000:3.0:1787360135.028627:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575074048:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:0.0:1787360135.028646:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360135.028651:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360135.028654:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360135.028657:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360135.028662:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575074048:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 36us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.029351:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:3.0:1787360135.029368:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:3.0:1787360135.029377:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575074176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360135.029492:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575074176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 116us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.029499:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000040:00080000:0.0:1787360135.033398:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360135.033406:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360135.033444:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787360135.033454:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360135.033588:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596091776:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360135.036166:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360135.042679:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13808:1874182596091776:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360135.045626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360135.045746:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074560 00000100:00100000:2.0:1787360135.045756:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074560 00000100:00100000:2.0:1787360135.045808:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:2.0:1787360135.045818:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:12487:x1874182575074560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360135.045861:0:6533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360135.046428:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+27:12487:x1874182575074560:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 610us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360135.046437:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 250 00000100:00100000:0.0:1787360135.052789:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360135.053310:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074816 00000100:00100000:3.0:1787360135.053320:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074816 00000100:00100000:3.0:1787360135.053775:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:3.0:1787360135.053788:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+27:12487:x1874182575074816:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360135.053808:0:11098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360135.053828:0:11098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721008 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3a4 expref: -99 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360135.053931:0:11098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee72100f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360135.053945:0:11098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee72100f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360135.053962:0:11098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee72100f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11098 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360135.053987:0:11098:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787360135.054191:0:11098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721008 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3a4 expref: 30 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360135.054210:0:11098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee72100f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3a4 expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360135.054218:0:11098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360135.054221:0:11098:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360135.054920:0:11098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9a00, rc 0) 00000100:00100000:3.0:1787360135.055055:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+29:12487:x1874182575074816:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1269us (2274us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787360135.055063:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 251 00000100:00100000:1.0:1787360135.059827:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360135.059868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360135.059939:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575074944 00000100:00100000:0.0:1787360135.059949:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575074944 00000100:00100000:0.0:1787360135.060010:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360135.060021:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+29:2400:x1874182575074944:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360135.060035:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360135.060068:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9a00/0x359a4e2aee72100f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3a4 expref: 29 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360135.060094:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:0.0:1787360135.060098:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360135.060152:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1121de3d-8714-4863-bc5d-127112ba378a+28:2400:x1874182575074944:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 132us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360135.060159:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787360135.060666:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575075200 00000100:00100000:2.0:1787360135.060672:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575075200 00000100:00100000:2.0:1787360135.060712:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:2.0:1787360135.060730:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+28:12487:x1874182575075200:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787360135.060790:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060805:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060815:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060955:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060962:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060968:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.060973:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360135.060978:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.061001:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.061012:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360135.061014:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360135.061018:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360135.061024:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a22697c00/0x359a4e2aee72101d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360135.061387:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360135.061396:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360135.061925:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787360135.061935:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360135.062116:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+29:12487:x1874182575075200:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 1393us (2244us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787360135.062126:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 252 00000100:00100000:1.0:1787360135.068348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360135.068463:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575075456 00000100:00100000:3.0:1787360135.068473:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575075456 00000100:00100000:3.0:1787360135.068534:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:3.0:1787360135.068544:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+29:12487:x1874182575075456:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360135.068755:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+30:12487:x1874182575075456:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 211us (414us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787360135.068763:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00010000:00010000:2.0:1787360135.289449:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360135.417970:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596091904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360135.418030:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360135.418041:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360135.418046:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596092032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360135.418096:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360135.418124:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596091904 00000100:00100000:1.0:1787360135.418131:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596091904 00000100:00100000:0.0:1787360135.418141:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092032 00000100:00100000:0.0:1787360135.418147:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092032 00000100:00100000:1.0:1787360135.418181:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787360135.418190:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596091904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787360135.418217:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360135.418281:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596091904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360135.418288:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787360135.418308:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787360135.418438:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596092544:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418473:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.418492:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596093056:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418511:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.418543:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787360135.418548:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596092160:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.418592:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418610:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.418623:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596093184:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418640:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.418663:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092672 00000100:00100000:3.0:1787360135.418667:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092672 00000100:00100000:3.0:1787360135.418692:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787360135.418698:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596092672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418743:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596092672:12345-0@lo:400:kworker.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.418750:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787360135.418765:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093056 00000100:00100000:3.0:1787360135.418768:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093056 00000100:00100000:3.0:1787360135.418787:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093184 00000100:00100000:3.0:1787360135.418789:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093184 00000100:00100000:3.0:1787360135.418803:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787360135.418808:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596093056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418832:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596093056:12345-0@lo:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.418837:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787360135.418846:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787360135.418851:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596093184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418868:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596093184:12345-0@lo:400:kworker.0 Request processed in 18us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.418882:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787360135.418912:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596092672:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418920:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596093184:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418927:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596093056:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.418965:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092160 00000100:00100000:3.0:1787360135.418967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092160 00000100:00100000:3.0:1787360135.418989:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787360135.418995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596092160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596092160:12345-0@lo:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419032:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787360135.419057:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596092288:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419079:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419095:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596092800:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419116:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419130:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596093312:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419146:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419162:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787360135.419169:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596092416:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419187:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419201:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596092928:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419218:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419253:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596093440:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419282:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360135.419302:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092416 00000100:00100000:3.0:1787360135.419306:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092416 00000100:00100000:3.0:1787360135.419329:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787360135.419336:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596092416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419369:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596092416:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419375:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787360135.419391:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092544 00000100:00100000:3.0:1787360135.419394:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092544 00000100:00100000:3.0:1787360135.419409:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092288 00000100:00100000:3.0:1787360135.419411:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092288 00000100:00100000:3.0:1787360135.419420:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092800 00000100:00100000:3.0:1787360135.419422:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092800 00000100:00100000:3.0:1787360135.419435:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093312 00000100:00100000:3.0:1787360135.419437:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093312 00000100:00100000:3.0:1787360135.419448:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596092928 00000100:00100000:3.0:1787360135.419450:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596092928 00000100:00100000:3.0:1787360135.419461:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093440 00000100:00100000:3.0:1787360135.419463:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093440 00000100:00100000:3.0:1787360135.419475:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787360135.419481:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596092544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419507:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596092544:12345-0@lo:400:kworker.0 Request processed in 27us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419512:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1787360135.419523:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787360135.419528:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596092288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419549:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596092288:12345-0@lo:400:kworker.0 Request processed in 21us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419563:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787360135.419575:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787360135.419581:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596092800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419607:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596092800:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419612:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787360135.419623:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787360135.419628:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596093312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419650:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596093312:12345-0@lo:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419655:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787360135.419665:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787360135.419671:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596092928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419694:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596092928:12345-0@lo:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419700:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1787360135.419711:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787360135.419717:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596093440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419756:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596093440:12345-0@lo:400:kworker.0 Request processed in 39us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360135.419762:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787360135.419792:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596092416:0@lo:400:kworker.0 00010000:00080000:3.0:1787360135.419803:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890492f100 x1874182596092928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360135.419826:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596092928:0@lo:400:kworker.0 00010000:00080000:3.0:1787360135.419839:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510ed80 x1874182596093440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360135.419847:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596093440:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419855:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596092288:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419863:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596092800:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419871:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596093312:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419902:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596092160:0@lo:400:kworker.0 00000100:00100000:3.0:1787360135.419912:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596092544:0@lo:400:kworker.0 00000100:00080000:3.0:1787360135.419982:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360135.419986:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360135.419989:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360135.419992:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360135.420023:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787360135.420028:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1787360135.420051:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998a037a7480, transno 4294967308 00000004:00080000:3.0:1787360135.420062:0:3661:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1787360135.420073:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99890432a300, transno 4294967311 00000100:00100000:3.0:1787360135.420085:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596091904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360135.420302:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596092032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787360135.420316:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787360135.420360:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596092032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (2264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360135.420367:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787360135.421456:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596092032:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787360136.313362:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360136.441422:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596093568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360136.441509:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360136.441595:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093568 00000100:00100000:0.0:1787360136.441603:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093568 00000100:00100000:0.0:1787360136.441662:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787360136.441672:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596093568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360136.441701:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787360136.443058:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596093568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1382us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360136.443070:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787360136.443528:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596093568:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787360136.616133:0:14824:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360136.616142:0:14824:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360136.616170:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787360136.616175:0:14824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787360136.809844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360136.810054:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575075712 00000100:00100000:3.0:1787360136.810064:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575075712 00000100:00100000:3.0:1787360136.810132:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00100000:3.0:1787360136.810143:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+30:12508:x1874182575075712:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360136.810164:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360136.810182:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721024 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3ab expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.810312:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee72102b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.810327:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee72102b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.810339:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee72102b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360136.810350:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787360136.810441:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721024 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ab expref: 33 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.810463:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee72102b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ab expref: 32 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.810472:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360136.810475:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787360136.810490:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8000, rc 0) 00000100:00100000:2.0:1787360136.810603:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+32:12508:x1874182575075712:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 459us (765us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787360136.810613:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 253 00000100:00080000:0.0:1787360136.810968:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360136.815747:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360136.815845:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575075840 00000100:00100000:3.0:1787360136.815854:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575075840 00000100:00100000:3.0:1787360136.816277:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:3.0:1787360136.816290:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+32:12508:x1874182575075840:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:3.0:1787360136.816373:0:9449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816391:0:9449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816402:0:9449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816435:0:9449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816442:0:9449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816449:0:9449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816454:0:9449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360136.816458:0:9449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816465:0:9449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816476:0:9449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:3.0:1787360136.816479:0:9449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360136.816497:0:9449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.816503:0:9449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8c00/0x359a4e2aee721039 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360136.816581:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1121de3d-8714-4863-bc5d-127112ba378a+32:12508:x1874182575075840:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 293us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360136.816590:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 254 00000100:00100000:1.0:1787360136.910934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360136.911031:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575075968 00000100:00100000:3.0:1787360136.911040:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575075968 00000100:00100000:3.0:1787360136.911136:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:3.0:1787360136.911147:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+7:2399:x1874182575075968:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:3.0:1787360136.911164:0:8770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360136.911182:0:8770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee721040 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3b2 expref: -99 pid: 8770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360136.911207:0:8770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a88f384, atime: 0x6a88f384, ctime: 0x6a88f384, blocks: 0x8 00010000:00010000:3.0:1787360136.911246:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787360136.911251:0:8770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360136.911260:0:8770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee721040 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b2 expref: 8 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.911279:0:8770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee721040 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b2 expref: 8 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360136.911292:0:8770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8c00, rc 0) 00000100:00100000:3.0:1787360136.911360:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+8:2399:x1874182575075968:12345-192.168.206.11@tcp:101:cat.0 Request processed in 215us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360136.911720:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 79 00000100:00100000:1.0:1787360136.914933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360136.915061:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076096 00000100:00100000:0.0:1787360136.915070:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076096 00002000:00100000:0.0:1787360136.915120:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff998a3ff46680 x1874182575076096/t0(0) o3->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:327/0 lens 488/0 e 0 to 0 dl 1787360147 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360136.915131:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998a3ff46680 with x1874182575076096 ext(0->4095) 00002000:00010000:0.0:1787360136.915136:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998a3ff46680 00000100:00100000:0.0:1787360136.915166:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:0.0:1787360136.915176:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575076096:12345-192.168.206.11@tcp:3:cat.0 00000100:00100000:0.0:1787360136.915451:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1121de3d-8714-4863-bc5d-127112ba378a+8:2400:x1874182575076096:12345-192.168.206.11@tcp:3:cat.0 Request processed in 275us (524us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787360136.915472:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00002000:00100000:0.0:1787360136.915480:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff998a3ff46680 x1874182575076096/t0(0) o3->1121de3d-8714-4863-bc5d-127112ba378a@192.168.206.11@tcp:327/0 lens 488/4536 e 0 to 0 dl 1787360147 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360136.915489:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff998a3ff46680 with x1874182575076096 ext(0->4095) 00002000:00010000:0.0:1787360136.915492:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff998a3ff46680 00010000:00010000:0.0:1787360137.338443:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360137.465734:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360137.465755:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596093696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360137.465816:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360137.465951:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093696 00000100:00100000:1.0:1787360137.465958:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093696 00000100:00100000:1.0:1787360137.466029:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787360137.466038:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596093696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787360137.466063:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787360137.466102:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3658:x1874182596093696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360137.466109:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787360137.466148:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596093696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360137.466239:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360137.466250:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596093824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360137.466284:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360137.466384:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093824 00000100:00100000:2.0:1787360137.466389:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093824 00000100:00080000:0.0:1787360137.466412:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360137.466429:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787360137.466437:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596093824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360137.466448:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787360137.466492:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596093824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360137.466498:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787360137.466621:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596093824:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787360137.785834:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787360138.170845:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360138.170855:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360138.170876:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787360138.170885:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787360138.365326:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360139.386997:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360139.513511:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360139.513533:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596093952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360139.513593:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360139.513718:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596093952 00000100:00100000:3.0:1787360139.513726:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596093952 00000100:00100000:3.0:1787360139.513820:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787360139.513831:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596093952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360139.513862:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787360139.513917:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596093952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360139.513925:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787360139.514338:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596093952:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1787360139.517356:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1787360139.517370:0:8442:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787360139.517819:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1787360139.517847:0:6511:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff998a136133c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787360139.517852:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a3c9f7e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff998a3cb8ed80 00000020:00080000:0.0:1787360139.517856:0:6511:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff998a3c9f7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9989036f0600 00000020:00080000:0.0:1787360139.517874:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1787360139.517967:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360139.517971:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:2.0:1787360139.517982:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360139.517990:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360139.517995:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeec00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360139.518000:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360139.518008:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360139.518023:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff998a07c29d00) 00010000:00010000:2.0:1787360139.518026:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360139.518030:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787360139.518033:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1787360139.518038:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caeec00/0x359a4e2aee720fbb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360140.150474:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360140.150526:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360140.150551:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076224 00000100:00100000:2.0:1787360140.150562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076224 00000100:00100000:2.0:1787360140.150619:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 395 00000100:00100000:2.0:1787360140.150644:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182575076224:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360140.150727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182575076224:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360140.150736:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 395 00000100:00100000:3.0:1787360140.150900:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076352 00000100:00100000:3.0:1787360140.150905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076352 00000100:00100000:3.0:1787360140.150960:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 348 00000100:00100000:3.0:1787360140.150968:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:2401:x1874182575076352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360140.151009:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:2401:x1874182575076352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.151015:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 348 00000100:00080000:0.0:1787360140.154314:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360140.157470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360140.157830:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076480 00000100:00100000:3.0:1787360140.157839:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076480 00000100:00100000:3.0:1787360140.157906:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 349 00000100:00100000:3.0:1787360140.157918:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575076480:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360140.157985:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575076480:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 70us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.158005:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 349 00000100:00100000:3.0:1787360140.158093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360140.158153:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076608 00000100:00100000:3.0:1787360140.158157:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076608 00000100:00100000:3.0:1787360140.158200:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:3.0:1787360140.158207:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2402:x1874182575076608:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360140.158262:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2402:x1874182575076608:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.158269:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00080000:2.0:1787360140.158616:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360140.158621:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360140.161438:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360140.161478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360140.161551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360140.161584:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076864 00000100:00100000:3.0:1787360140.161595:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076864 00000100:00100000:3.0:1787360140.161710:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076992 00000100:00100000:3.0:1787360140.161715:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076992 00000100:00100000:3.0:1787360140.161743:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 350 00000100:00100000:3.0:1787360140.161752:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575076864:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360140.161815:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575076864:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 64us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.161823:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 350 00000100:00100000:3.0:1787360140.161839:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 351 00000100:00100000:3.0:1787360140.161845:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575076992:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360140.161868:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2402:x1874182575076992:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.161890:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 351 00000100:00080000:3.0:1787360140.161909:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360140.161913:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360140.162459:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575076736 00000100:00100000:0.0:1787360140.162465:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575076736 00000100:00100000:0.0:1787360140.162521:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:0.0:1787360140.162537:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575076736:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360140.162577:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575076736:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 42us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.162583:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00080000:3.0:1787360140.162966:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787360140.409720:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360140.537769:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596094080:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.537840:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.537884:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596094592:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.537908:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.537927:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596095104:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.537949:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.537964:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596095616:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.537982:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.538002:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787360140.538007:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596094208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.538026:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.538041:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596094720:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.538058:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.538071:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596095232:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.538090:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.538117:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596094336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.538139:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.538157:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596094848:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539302:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539348:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596095360:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539559:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539587:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596095872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360140.539610:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539632:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787360140.539639:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596094464:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539659:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539669:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596094976:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539687:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539717:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596095488:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539737:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.539776:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094080 00000100:00100000:3.0:1787360140.539783:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094080 00000100:00100000:3.0:1787360140.539830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787360140.539839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596094080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596094080:12345-0@lo:400:kworker.0 Request processed in 42us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.539887:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787360140.539918:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094592 00000100:00100000:3.0:1787360140.539922:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094592 00000100:00100000:3.0:1787360140.539942:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094336 00000100:00100000:3.0:1787360140.539945:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094336 00000100:00100000:3.0:1787360140.539958:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787360140.539963:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596094592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.539995:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596094592:12345-0@lo:400:kworker.0 Request processed in 32us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.540001:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787360140.540020:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787360140.540026:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596094336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.540060:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596094336:12345-0@lo:400:kworker.0 Request processed in 35us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.540066:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787360140.540083:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095104 00000100:00100000:3.0:1787360140.540086:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095104 00000100:00100000:3.0:1787360140.540111:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095616 00000100:00100000:3.0:1787360140.540113:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095616 00000100:00100000:3.0:1787360140.540124:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094976 00000100:00100000:3.0:1787360140.540126:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094976 00000100:00100000:3.0:1787360140.540136:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095488 00000100:00100000:3.0:1787360140.540138:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095488 00000100:00100000:3.0:1787360140.540150:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787360140.540155:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596095104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.540378:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094208 00000100:00100000:0.0:1787360140.540383:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094208 00000100:00100000:0.0:1787360140.540403:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094720 00000100:00100000:0.0:1787360140.540406:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094720 00000100:00100000:0.0:1787360140.540420:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095232 00000100:00100000:0.0:1787360140.540422:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095232 00000100:00100000:0.0:1787360140.540432:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094848 00000100:00100000:0.0:1787360140.540434:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094848 00000100:00100000:0.0:1787360140.540444:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095360 00000100:00100000:0.0:1787360140.540447:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095360 00000100:00100000:0.0:1787360140.540457:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596094464 00000100:00100000:0.0:1787360140.540459:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596094464 00000100:00100000:0.0:1787360140.540470:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787360140.540475:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596094208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360140.540546:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787360140.540554:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596094720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.540898:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596094208:12345-0@lo:400:kworker.0 Request processed in 422us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.540905:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787360140.540922:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787360140.540928:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596095232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.540957:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596095232:12345-0@lo:400:kworker.0 Request processed in 30us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.540963:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787360140.540976:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787360140.540999:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596094848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.541030:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596094848:12345-0@lo:400:kworker.0 Request processed in 32us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.541036:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1787360140.541051:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787360140.541056:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596095360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.541080:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596095360:12345-0@lo:400:kworker.0 Request processed in 24us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.541086:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1787360140.541098:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787360140.541104:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596094464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360140.541129:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596094464:12345-0@lo:400:kworker.0 Request processed in 26us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360140.541135:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1787360140.541658:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596094720:12345-0@lo:400:kworker.0 Request processed in 1104us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360140.541666:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787360140.543139:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596095104:12345-0@lo:400:kworker.0 Request processed in 2976us (5181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543151:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787360140.543186:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787360140.543198:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596095616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543268:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596095616:12345-0@lo:400:kworker.0 Request processed in 74us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543274:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787360140.543285:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787360140.543292:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596094976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543321:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596094976:12345-0@lo:400:kworker.0 Request processed in 30us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543347:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787360140.543362:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787360140.543368:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596095488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543398:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596095488:12345-0@lo:400:kworker.0 Request processed in 30us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543403:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787360140.543443:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095872 00000100:00100000:3.0:1787360140.543450:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095872 00000100:00100000:3.0:1787360140.543484:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787360140.543491:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596095872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360140.543510:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360140.543538:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596095872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543543:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1787360140.543572:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360140.543576:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360140.543579:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360140.543581:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360140.543596:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596095744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360140.543627:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360140.543661:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596095744 00000100:00100000:3.0:1787360140.543664:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596095744 00000100:00100000:3.0:1787360140.543683:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787360140.543690:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596095744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360140.543711:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360140.543737:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596095744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360140.543748:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787360140.543785:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596095744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360140.543819:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596094208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543830:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596094720:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543840:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596095232:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543850:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596094080:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543860:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596094592:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543868:0:3658:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787360140.543873:0:3658:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998a3ff46a00, transno 4294967323 00000004:00080000:3.0:1787360140.543882:0:3658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1787360140.543895:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596095104:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.543905:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596095616:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.544512:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596094464:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.544524:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596094976:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.544532:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596095488:0@lo:400:kworker.0 00000100:00100000:3.0:1787360140.544543:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596095872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360140.544552:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596094336:0@lo:400:kworker.0 00010000:00080000:3.0:1787360140.544565:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890492c000 x1874182596094848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360140.544586:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596094848:0@lo:400:kworker.0 00010000:00080000:3.0:1787360140.544601:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a2680 x1874182596095360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360140.544609:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596095360:0@lo:400:kworker.0 00000100:00100000:0.0:1787360141.164440:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360141.164742:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077120 00000100:00100000:3.0:1787360141.164751:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077120 00000100:00100000:3.0:1787360141.164805:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00100000:3.0:1787360141.164815:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:12160:x1874182575077120:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787360141.165012:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+18:12160:x1874182575077120:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 197us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360141.165022:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 255 00000100:00100000:0.0:1787360141.166510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360141.171338:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077248 00000100:00100000:3.0:1787360141.171354:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077248 00000100:00100000:3.0:1787360141.171491:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00100000:3.0:1787360141.171502:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:12160:x1874182575077248:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787360141.171615:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:12160:x1874182575077248:12345-192.168.206.11@tcp:60:lhsmtool_posix.0 Request processed in 114us (5111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360141.171622:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 256 00000100:00100000:0.0:1787360141.177795:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360141.177890:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077504 00000100:00100000:2.0:1787360141.177910:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077504 00000100:00100000:2.0:1787360141.177964:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360141.177973:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+18:12160:x1874182575077504:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787360141.178175:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+19:12160:x1874182575077504:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 202us (388us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787360141.178183:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 65 00000100:00100000:2.0:1787360141.375717:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360141.375901:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077632 00000100:00100000:3.0:1787360141.375914:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077632 00000100:00100000:3.0:1787360141.376058:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 257 00000100:00100000:3.0:1787360141.376071:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:12965:x1874182575077632:12345-192.168.206.11@tcp:101:lsof.0 00010000:00010000:3.0:1787360141.376099:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360141.376146:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee721047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376257:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376274:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376291:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360141.376377:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360141.376381:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360141.376419:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376449:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9600/0x359a4e2aee721047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b9 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376483:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b9 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360141.376493:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:3.0:1787360141.376496:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360141.376500:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a9e00, rc 0) 00000100:00100000:3.0:1787360141.376593:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:12965:x1874182575077632:12345-192.168.206.11@tcp:101:lsof.0 Request processed in 525us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360141.376603:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 257 00010000:00010000:2.0:1787360141.434649:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360141.561684:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596096000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360141.561826:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360141.561955:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096000 00000100:00100000:0.0:1787360141.561967:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096000 00000100:00100000:0.0:1787360141.562044:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787360141.562066:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596096000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787360141.562109:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787360141.564151:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596096000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2082us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360141.564168:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787360141.564222:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596096000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787360142.457706:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360142.586255:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596096128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360142.586366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360142.586604:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096128 00000100:00100000:3.0:1787360142.586614:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096128 00000100:00100000:3.0:1787360142.586711:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787360142.586723:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596096128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360142.586757:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787360142.587286:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596096128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 562us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360142.587297:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1787360142.588317:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360142.590407:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596096256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360142.590503:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360142.590656:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096256 00000100:00100000:0.0:1787360142.590667:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096256 00000100:00100000:0.0:1787360142.590760:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787360142.590772:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596096256:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787360142.590905:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787360142.590957:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787360142.591026:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596096256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360142.591034:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787360142.591190:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596096256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360142.592370:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596096128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787360143.481539:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360144.511614:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787360144.618627:0:15021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:55:43 (1787360143) 00000100:00100000:0.0:1787360144.634345:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360144.634374:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596096384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360144.634463:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360144.634542:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096384 00000100:00100000:0.0:1787360144.634550:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096384 00000100:00100000:0.0:1787360144.634608:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787360144.634619:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596096384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360144.634662:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360144.634727:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596096384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360144.634735:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787360144.634791:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596096384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360145.256440:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360145.256496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360145.256524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360145.256570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360145.256594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360145.257261:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077888 00000100:00100000:3.0:1787360145.257276:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077888 00000100:00100000:3.0:1787360145.257375:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078400 00000100:00100000:3.0:1787360145.257380:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078400 00000100:00100000:3.0:1787360145.257413:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 358 00000100:00100000:3.0:1787360145.257436:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:2401:x1874182575077888:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.257538:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+19:2401:x1874182575077888:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 105us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.257546:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 358 00000100:00100000:3.0:1787360145.257584:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 359 00000100:00100000:3.0:1787360145.257601:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2401:x1874182575078400:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.257628:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2401:x1874182575078400:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.257634:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 359 00000100:00100000:3.0:1787360145.257663:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078144 00000100:00100000:3.0:1787360145.257679:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078144 00000100:00100000:3.0:1787360145.257715:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00100000:3.0:1787360145.257723:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575078144:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.257755:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2401:x1874182575078144:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.257762:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 147 00000100:00080000:3.0:1787360145.257778:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360145.257784:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360145.257974:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575077760 00000100:00100000:3.0:1787360145.257980:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575077760 00000100:00100000:3.0:1787360145.258013:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 397 00000100:00100000:3.0:1787360145.258020:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182575077760:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.258052:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182575077760:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.258059:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 397 00000100:00100000:3.0:1787360145.266764:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078016 00000100:00100000:3.0:1787360145.266786:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078016 00000100:00100000:3.0:1787360145.266893:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 360 00000100:00100000:3.0:1787360145.266907:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575078016:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.267007:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575078016:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 104us (10410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.267034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 360 00000100:00080000:2.0:1787360145.267141:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787360145.267797:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360145.267838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360145.267876:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078528 00000100:00100000:3.0:1787360145.267883:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078528 00000100:00100000:3.0:1787360145.267932:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00100000:3.0:1787360145.267941:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575078528:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360145.267989:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2401:x1874182575078528:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.267997:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 361 00000100:00080000:3.0:1787360145.268016:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360145.268521:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078272 00000100:00100000:2.0:1787360145.268527:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078272 00000100:00100000:2.0:1787360145.268582:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00100000:2.0:1787360145.268591:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575078272:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360145.268647:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1121de3d-8714-4863-bc5d-127112ba378a+5:2401:x1874182575078272:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360145.268654:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 148 00000100:00080000:2.0:1787360145.268695:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787360145.529825:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360145.657401:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596096512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360145.657495:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.657771:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096512 00000100:00100000:3.0:1787360145.657779:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096512 00000100:00100000:3.0:1787360145.657914:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787360145.657929:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596096512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360145.657967:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787360145.658020:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596096512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.658028:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787360145.658063:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596096768:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.658103:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.658129:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596097280:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.658153:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.658182:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596097792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.659515:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596096640:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660102:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360145.660162:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596097152:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660195:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360145.660326:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596097664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660355:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360145.660483:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096768 00000100:00100000:1.0:1787360145.660492:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096768 00000100:00100000:1.0:1787360145.660539:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097280 00000100:00100000:1.0:1787360145.660543:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097280 00000100:00100000:1.0:1787360145.660716:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787360145.660727:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596096768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660785:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596096768:12345-0@lo:400:kworker.0 Request processed in 60us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.660793:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787360145.660810:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787360145.660816:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596097280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660845:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596097280:12345-0@lo:400:kworker.0 Request processed in 29us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.660852:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787360145.660878:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096640 00000100:00100000:1.0:1787360145.660881:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096640 00000100:00100000:1.0:1787360145.660908:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787360145.660914:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596096640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.660946:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596096640:12345-0@lo:400:kworker.0 Request processed in 32us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.660952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787360145.661111:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097152 00000100:00100000:1.0:1787360145.661116:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097152 00000100:00100000:1.0:1787360145.661145:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787360145.661152:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596097152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.661198:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596097152:12345-0@lo:400:kworker.0 Request processed in 47us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.661204:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787360145.661322:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097664 00000100:00100000:1.0:1787360145.661327:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097664 00000100:00100000:1.0:1787360145.661435:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787360145.661445:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596097664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.661480:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596097664:12345-0@lo:400:kworker.0 Request processed in 38us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.661486:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787360145.661533:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596096640:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.661547:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596097152:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.661556:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596097664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.661922:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596096896:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.662060:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.662093:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097792 00000100:00100000:3.0:1787360145.662098:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097792 00000100:00100000:1.0:1787360145.662116:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596097408:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.662140:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787360145.662147:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.662152:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662172:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596097920:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.662215:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596097792:12345-0@lo:400:kworker.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.662221:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1787360145.662255:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097408 00000100:00100000:3.0:1787360145.662258:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097408 00000100:00100000:3.0:1787360145.662281:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787360145.662287:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662307:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360145.662334:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596097408:12345-0@lo:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.662341:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:1.0:1787360145.662346:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904917480 x1874182596097408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360145.662352:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097920 00000100:00100000:3.0:1787360145.662356:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097920 00000100:00100000:3.0:1787360145.662372:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1787360145.662377:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596097920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.662401:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596097920:12345-0@lo:400:kworker.0 Request processed in 24us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.662406:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1787360145.662445:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596097408:0@lo:400:kworker.0 00010000:00080000:1.0:1787360145.662463:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a0700 x1874182596097920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360145.662478:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596097792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662493:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596097920:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.662509:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596096768:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662511:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787360145.662523:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596097024:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.662525:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596097280:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662555:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787360145.662571:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360145.662583:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360145.662585:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360145.662588:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360145.662820:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596097536:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662849:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360145.662871:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.662893:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360145.662926:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596096896 00000100:00100000:1.0:1787360145.662931:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596096896 00000100:00100000:1.0:1787360145.663033:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787360145.663080:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097024 00000100:00100000:3.0:1787360145.663085:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097024 00000100:00100000:1.0:1787360145.663107:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596096896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.663112:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787360145.663122:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596097024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.663163:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596096896:12345-0@lo:400:kworker.0 Request processed in 60us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360145.663173:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787360145.663185:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596097024:12345-0@lo:400:kworker.0 Request processed in 64us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.663193:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1787360145.663343:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596097024:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.663352:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596097536 00000100:00100000:3.0:1787360145.663357:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596097536 00000100:00100000:3.0:1787360145.663391:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098048 00000100:00100000:3.0:1787360145.663394:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098048 00000100:00100000:1.0:1787360145.663434:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596096896:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.663487:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596096512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787360145.663525:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787360145.663534:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596097536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.663576:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596097536:12345-0@lo:400:kworker.0 Request processed in 43us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.663582:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787360145.663593:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787360145.663599:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.663626:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596098048:12345-0@lo:400:kworker.0 Request processed in 27us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360145.663632:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1787360145.663650:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360145.663652:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360145.663684:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596097536:0@lo:400:kworker.0 00000100:00100000:3.0:1787360145.663704:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596098048:0@lo:400:kworker.0 00000100:00100000:1.0:1787360145.667701:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596098176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360145.667882:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360145.668849:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098176 00000100:00100000:2.0:1787360145.668861:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098176 00000100:00100000:2.0:1787360145.668937:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787360145.668950:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596098176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360145.668981:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787360145.669053:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596098176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360145.669061:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787360145.669124:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596098176:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787360145.673571:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1787360145.673595:0:6511:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787360145.674293:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787360145.674322:0:6563:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787360146.553463:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360146.681965:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360146.681988:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596098304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360146.682056:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360146.682265:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098304 00000100:00100000:1.0:1787360146.682281:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098304 00000100:00100000:1.0:1787360146.682427:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787360146.682438:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596098304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360146.682472:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1787360146.682527:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596098304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360146.682533:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787360146.682786:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596098304:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787360147.002069:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787360147.577382:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360147.705506:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596098432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360147.705589:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360147.705790:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098432 00000100:00100000:0.0:1787360147.705798:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098432 00000100:00100000:0.0:1787360147.705864:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787360147.705875:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596098432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360147.705920:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787360147.705971:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596098432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360147.705979:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1787360147.706092:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360147.706134:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596098432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360147.706591:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596098560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360147.706630:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360147.706931:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098560 00000100:00100000:3.0:1787360147.706937:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098560 00000100:00100000:3.0:1787360147.706997:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787360147.707006:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596098560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360147.707022:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787360147.707061:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596098560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360147.707068:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787360147.707481:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360147.707516:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596098560:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1787360148.409489:0:13808:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360148.409497:0:13808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360148.409601:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787360148.409608:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787360148.601480:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360149.175090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360149.175183:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575078784 00000100:00100000:3.0:1787360149.175194:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575078784 00000100:00100000:3.0:1787360149.175302:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00100000:3.0:1787360149.175323:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+18:13188:x1874182575078784:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:3.0:1787360149.175587:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:13188:x1874182575078784:12345-192.168.206.11@tcp:35:umount.0 Request processed in 275us (505us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787360149.175595:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 66 00000100:00080000:1.0:1787360149.175781:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360149.181394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360149.181562:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079040 00000100:00100000:1.0:1787360149.181572:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079040 00000100:00100000:1.0:1787360149.181785:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:1.0:1787360149.181797:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+19:13188:x1874182575079040:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:1.0:1787360149.182085:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+20:13188:x1874182575079040:12345-192.168.206.11@tcp:35:umount.0 Request processed in 288us (699us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787360149.182094:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 67 00000100:00100000:0.0:1787360149.184971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360149.185217:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079296 00000100:00100000:2.0:1787360149.185261:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079296 00000100:00100000:2.0:1787360149.185384:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:2.0:1787360149.185395:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a20561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+20:13188:x1874182575079296:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:2.0:1787360149.185841:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a20561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1121de3d-8714-4863-bc5d-127112ba378a+21:13188:x1874182575079296:12345-192.168.206.11@tcp:35:umount.0 Request processed in 446us (876us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787360149.185850:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 68 00000100:00100000:0.0:1787360149.189112:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360149.189380:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079552 00000100:00100000:1.0:1787360149.189390:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079552 00000100:00100000:1.0:1787360149.189479:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:1.0:1787360149.189491:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:13188:x1874182575079552:12345-192.168.206.11@tcp:35:umount.0 00000100:00100000:1.0:1787360149.189921:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:13188:x1874182575079552:12345-192.168.206.11@tcp:35:umount.0 Request processed in 431us (815us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787360149.189946:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 69 00000100:00100000:3.0:1787360149.193050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360149.193097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360149.193751:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079680 00000100:00100000:0.0:1787360149.193761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079680 00000100:00100000:0.0:1787360149.193818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079808 00000100:00100000:0.0:1787360149.193821:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079808 00000100:00100000:0.0:1787360149.193851:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360149.193860:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+14:2401:x1874182575079680:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360149.193875:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360149.193893:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350ab200/0x359a4e2aee720025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef0c expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360149.193910:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360149.193958:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+13:2401:x1874182575079680:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 99us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360149.193965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360149.193983:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1787360149.193990:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+12:2402:x1874182575079808:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360149.193996:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360149.194005:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696800/0x359a4e2aee71ff68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeecd expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360149.194013:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360149.194041:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:2402:x1874182575079808:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 51us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360149.194048:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1787360149.194601:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360149.194624:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575079936 00000100:00100000:2.0:1787360149.194629:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575079936 00000100:00100000:2.0:1787360149.194672:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360149.194680:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+11:2399:x1874182575079936:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360149.194689:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360149.194699:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689600/0x359a4e2aee720278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefe5 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.194710:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360149.194732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2399:x1874182575079936:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360149.194739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:0.0:1787360149.197220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360149.197931:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575080064 00000100:00100000:3.0:1787360149.197941:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575080064 00000100:00100000:3.0:1787360149.198059:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 80 00000100:00100000:3.0:1787360149.198070:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182575080064:12345-192.168.206.11@tcp:9:umount.0 00000020:00000080:3.0:1787360149.198111:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee720343 00000100:00080000:3.0:1787360149.198122:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998a1a511000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360149.198171:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787360149.198351:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1121de3d-8714-4863-bc5d-127112ba378a+2:2398:x1874182575080064:12345-192.168.206.11@tcp:9:umount.0 Request processed in 283us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360149.198360:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 80 00010000:00010000:0.0:1787360149.198547:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360149.200463:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360149.208854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360149.208977:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575080448 00000100:00100000:3.0:1787360149.208988:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575080448 00000100:00100000:3.0:1787360149.209054:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 81 00000100:00100000:3.0:1787360149.209064:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+7:2398:x1874182575080448:12345-192.168.206.11@tcp:9:umount.0 00000020:00000080:3.0:1787360149.209089:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee7205b9 00000020:00010000:3.0:1787360149.209095:0:8450:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998a3784b000: total 0 00000100:00080000:3.0:1787360149.209109:0:8450:0:(import.c:65:import_set_state_nolock()) ffff998a3784d800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787360149.209215:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1787360149.209310:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787360149.209459:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182575080448:12345-192.168.206.11@tcp:9:umount.0 Request processed in 395us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360149.209468:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 81 00000020:00010000:2.0:1787360149.209882:0:6519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998a3784b000: total 0 00010000:00010000:2.0:1787360149.209922:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998a3784b000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787360149.209984:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee720971 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1cf expref: 4 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.210019:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da60000/0x359a4e2aee721040 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b2 expref: 3 pid: 8770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.210033:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998a3784b000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787360149.210059:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360149.210060:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360149.210062:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360149.216738:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360149.218349:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575081472 00000100:00100000:1.0:1787360149.218363:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575081472 00000100:00100000:1.0:1787360149.218432:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 258 00000100:00100000:1.0:1787360149.218442:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+22:2398:x1874182575081472:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:1.0:1787360149.218474:0:6532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff76 00000020:00010000:1.0:1787360149.218492:0:6532:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998903b18000: total 0 00000100:00080000:1.0:1787360149.218497:0:6532:0:(import.c:65:import_set_state_nolock()) ffff998903b1d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360149.218526:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1787360149.218713:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1121de3d-8714-4863-bc5d-127112ba378a+21:2398:x1874182575081472:12345-192.168.206.11@tcp:39:umount.0 Request processed in 271us (1982us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787360149.218721:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 258 00000020:00010000:2.0:1787360149.218871:0:7473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998903b18000: total 0 00010000:00010000:2.0:1787360149.218922:0:7473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998903b18000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787360149.218960:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998902719e00) 00010000:00010000:2.0:1787360149.218964:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360149.218973:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350aa000/0x359a4e2aee7202a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeff3 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219013:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360149.219015:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787360149.219020:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8200/0x359a4e2aee7209f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1f2 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219035:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360149.219038:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360149.219042:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9400/0x359a4e2aee720852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef182 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219058:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360149.219060:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787360149.219064:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8000/0x359a4e2aee72102b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ab expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219077:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360149.219079:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787360149.219083:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71a00/0x359a4e2aee720319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef00f expref: 16 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219121:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff998a227ada00) 00010000:00010000:2.0:1787360149.219123:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360149.219127:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef600/0x359a4e2aee720ce3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef2cb expref: 15 pid: 9449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219142:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360149.219144:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360149.219147:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9000/0x359a4e2aee721001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef39d expref: 14 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219159:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998902719800) 00010000:00010000:2.0:1787360149.219161:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360149.219165:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a350abc00/0x359a4e2aee7202be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eeffa expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219178:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360149.219180:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360149.219184:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01517e00/0x359a4e2aee720932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1ba expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219197:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff998a28ed6d00) 00010000:00010000:2.0:1787360149.219199:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787360149.219203:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a3caef000/0x359a4e2aee72095c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1c8 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219217:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:2.0:1787360149.219220:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360149.219263:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a00031800/0x359a4e2aee7209da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef1eb expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219280:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff998a3d37b300) 00010000:00010000:2.0:1787360149.219282:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360149.219285:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71000/0x359a4e2aee720614 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef0e8 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219297:0:7473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff998a029e8f00) 00010000:00010000:2.0:1787360149.219299:0:7473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360149.219303:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a8600/0x359a4e2aee720f21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef365 expref: 8 pid: 11098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360149.219315:0:7473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998903b18000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787360149.219329:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360149.219331:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360149.219333:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360149.230533:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360149.230622:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575081600 00000100:00100000:1.0:1787360149.230633:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575081600 00000100:00100000:1.0:1787360149.230721:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 259 00000100:00100000:1.0:1787360149.230733:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+5:2398:x1874182575081600:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:1.0:1787360149.230765:0:11098:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff7d 00000100:00080000:1.0:1787360149.230782:0:11098:0:(import.c:65:import_set_state_nolock()) ffff99890373c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360149.230811:0:11098:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787360149.230854:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360149.230975:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1121de3d-8714-4863-bc5d-127112ba378a+3:2398:x1874182575081600:12345-192.168.206.11@tcp:39:umount.0 Request processed in 243us (450us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787360149.230982:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 259 00000100:00080000:0.0:1787360149.240538:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787360149.625617:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360149.754672:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360149.754694:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596098688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360149.754784:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360149.755036:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098688 00000100:00100000:0.0:1787360149.755044:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098688 00000100:00100000:0.0:1787360149.755088:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787360149.755097:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596098688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360149.755128:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787360149.755180:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596098688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360149.755187:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787360149.755272:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596098688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360150.376032:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360150.376074:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360150.376120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360150.376265:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575081728 00000100:00100000:3.0:1787360150.376275:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575081728 00000100:00100000:1.0:1787360150.376299:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575081984 00000100:00100000:1.0:1787360150.376305:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575081984 00000100:00100000:3.0:1787360150.376343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 399 00000100:00100000:3.0:1787360150.376355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182575081728:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360150.376364:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575081856 00000100:00100000:1.0:1787360150.376369:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575081856 00000100:00100000:1.0:1787360150.376395:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 368 00000100:00100000:1.0:1787360150.376404:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575081984:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360150.376425:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2400:x1874182575081728:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 71us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.376447:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2400:x1874182575081984:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360150.376449:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 399 00000100:00100000:1.0:1787360150.376461:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 368 00000100:00100000:1.0:1787360150.376482:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00100000:1.0:1787360150.376490:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575081856:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360150.376517:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2400:x1874182575081856:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.376524:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 369 00000100:00080000:0.0:1787360150.377027:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360150.377032:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787360150.649510:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360150.777451:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596098816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360150.777530:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.777570:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596099072:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.777612:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.777633:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596099584:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.777666:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.777683:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596100096:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.777703:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.777722:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787360150.777722:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596099328:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.777732:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596098944:0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.777839:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596099200:0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.777965:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099072 00000100:00100000:0.0:1787360150.777974:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099072 00000100:00100000:0.0:1787360150.778021:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099584 00000100:00100000:0.0:1787360150.778024:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099584 00000100:00100000:0.0:1787360150.778051:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100096 00000100:00100000:0.0:1787360150.778054:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100096 00000100:00100000:0.0:1787360150.778071:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787360150.778080:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596099072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.791630:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1874182596099072:12345-0@lo:400:kworker.0 Request processed in 13541us (14007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.791655:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1787360150.791691:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1787360150.791703:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596099584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.791751:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596099584:12345-0@lo:400:kworker.0 Request processed in 52us (14083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.791757:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1787360150.791770:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787360150.791777:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596100096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.791806:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596100096:12345-0@lo:400:kworker.0 Request processed in 30us (14102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.791811:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:0.0:1787360150.791870:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360150.791945:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360150.791959:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596100608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360150.791995:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360150.792146:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098816 00000100:00100000:0.0:1787360150.792153:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098816 00000100:00100000:0.0:1787360150.792202:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100608 00000100:00100000:0.0:1787360150.792205:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100608 00000100:00100000:0.0:1787360150.792221:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787360150.792252:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596098816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360150.792275:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360150.792308:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596098816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (14780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.792328:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787360150.792341:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787360150.792347:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596100608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360150.792356:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360150.792385:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596100608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.792391:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787360150.792433:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596100608:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787360150.792451:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360150.794515:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360150.794582:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596099840:0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.794658:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360150.794697:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099840 00000100:00100000:1.0:1787360150.794704:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099840 00000100:00100000:1.0:1787360150.794762:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787360150.794785:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.794828:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596099840:12345-0@lo:400:kworker.0 Request processed in 46us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.794835:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787360150.794858:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360150.794883:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596099840:0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.794890:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596100352:0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.794913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360150.794935:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100352 00000100:00100000:1.0:1787360150.794938:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100352 00000100:00100000:1.0:1787360150.794969:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360150.794975:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.795006:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596100352:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.795011:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360150.795035:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596100352:0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.795052:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596098816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360150.795328:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099328 00000100:00100000:0.0:1787360150.795334:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099328 00000100:00100000:0.0:1787360150.795374:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787360150.795381:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596099328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.795422:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596099328:12345-0@lo:400:kworker.0 Request processed in 42us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.795428:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787360150.795545:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360150.795635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596098944 00000100:00100000:0.0:1787360150.795654:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596098944 00000100:00100000:0.0:1787360150.795682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787360150.795689:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596098944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.795985:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596098944:12345-0@lo:400:kworker.0 Request processed in 296us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.795992:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1787360150.796269:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890492df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596098944:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796282:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596099456:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796312:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.796333:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796356:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.796373:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596100480:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796394:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360150.796418:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3661:1874182596099072:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796431:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596099584:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.796442:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596100096:0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.796520:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099456 00000100:00100000:0.0:1787360150.796525:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099456 00000100:00100000:0.0:1787360150.796646:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787360150.796656:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596099456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.796696:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596099456:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.796702:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787360150.796772:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596099456:0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.796906:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360150.796971:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596099712:0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.796997:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360150.797025:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596100224:0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.797046:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360150.797070:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099712 00000100:00100000:2.0:1787360150.797074:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099712 00000100:00100000:1.0:1787360150.797104:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099968 00000100:00100000:1.0:1787360150.797109:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099968 00000100:00100000:2.0:1787360150.797138:0:11098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100224 00000100:00100000:2.0:1787360150.797143:0:11098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100224 00000100:00100000:1.0:1787360150.797147:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100480 00000100:00100000:1.0:1787360150.797152:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100480 00000100:00100000:2.0:1787360150.797175:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787360150.797182:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787360150.797191:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596099968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.797250:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596099968:12345-0@lo:400:kworker.0 Request processed in 60us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.797257:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787360150.797278:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787360150.797285:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.797316:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596100480:12345-0@lo:400:kworker.0 Request processed in 32us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.797321:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787360150.797353:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1787360150.797360:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596100224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360150.797387:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596100224:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360150.797393:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:1.0:1787360150.797411:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360150.797415:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787360150.797437:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596099328:0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.797451:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596099712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360150.797497:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596099712:12345-0@lo:400:kworker.0 Request processed in 308us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360150.797504:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00080000:2.0:1787360150.797533:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902916300 x1874182596100224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360150.797542:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596100224:0@lo:400:kworker.0 00010000:00080000:2.0:1787360150.797625:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998902915880 x1874182596099712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360150.797635:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596099712:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.797739:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596099968:0@lo:400:kworker.0 00000100:00100000:3.0:1787360150.797749:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596100480:0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.797871:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596099200 00000100:00100000:0.0:1787360150.797875:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596099200 00000100:00100000:0.0:1787360150.797904:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787360150.797911:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596099200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360150.797988:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596099200:12345-0@lo:400:kworker.0 Request processed in 76us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360150.797995:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787360150.798064:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596099200:0@lo:400:kworker.0 00000100:00100000:2.0:1787360151.113149:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360151.113276:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360151.117082:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360151.118238:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575082112 00000100:00100000:1.0:1787360151.118257:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575082112 00000100:00100000:1.0:1787360151.118494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575082368 00000100:00100000:1.0:1787360151.118498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575082368 00000100:00100000:1.0:1787360151.118530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1787360151.118540:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+11:2401:x1874182575082112:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360151.118555:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360151.118574:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040200/0x359a4e2aee720079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef21 expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360151.118663:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360151.118732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360151.118744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+10:2401:x1874182575082368:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360151.118755:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360151.118775:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688600/0x359a4e2aee720271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eefde expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360151.118787:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360151.118796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:89778f7a-f278-4db1-8669-35e9fc15f33b+9:2401:x1874182575082112:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 256us (5654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360151.118806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:3.0:1787360151.118812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+9:2401:x1874182575082368:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 70us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360151.118829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:2.0:1787360151.125341:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360151.125479:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575082240 00000100:00100000:3.0:1787360151.125489:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575082240 00000100:00100000:3.0:1787360151.125558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:3.0:1787360151.125568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+8:2401:x1874182575082240:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360151.125585:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360151.125604:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041e00/0x359a4e2aee720080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef52 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360151.125620:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360151.125688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:89778f7a-f278-4db1-8669-35e9fc15f33b+7:2401:x1874182575082240:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 121us (8615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360151.125696:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1787360151.125833:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575082624 00000100:00100000:1.0:1787360151.125839:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575082624 00000100:00100000:1.0:1787360151.125884:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 260 00000100:00100000:1.0:1787360151.125892:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+6:2398:x1874182575082624:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:1.0:1787360151.125986:0:6533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee72008e 00000020:00010000:1.0:1787360151.125994:0:6533:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998902a58000: total 0 00000100:00080000:1.0:1787360151.125998:0:6533:0:(import.c:65:import_set_state_nolock()) ffff998902a5e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360151.126020:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1787360151.126165:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2398:x1874182575082624:12345-192.168.206.11@tcp:39:umount.0 Request processed in 272us (830us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1787360151.126173:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 260 00000020:00010000:1.0:1787360151.126192:0:6520:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998902a58000: total 0 00010000:00010000:1.0:1787360151.126196:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360151.126266:0:6520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998902a58000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787360151.126318:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998902718b00) 00010000:00010000:1.0:1787360151.126321:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360151.126327:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a067a9e00/0x359a4e2aee72104e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3b9 expref: 4 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360151.126348:0:6520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998902a58000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787360151.126370:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360151.126372:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360151.126374:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360151.140354:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360151.140792:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575082752 00000100:00100000:1.0:1787360151.140801:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575082752 00000100:00100000:1.0:1787360151.140857:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:1.0:1787360151.140867:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+5:2398:x1874182575082752:12345-192.168.206.11@tcp:39:umount.0 00000020:00000080:1.0:1787360151.140905:0:9449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee720095 00000100:00080000:1.0:1787360151.141040:0:9449:0:(import.c:65:import_set_state_nolock()) ffff998902a59000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360151.141073:0:9449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787360151.141334:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360151.141527:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd1197f3-ef26-42bb-9c8a-916d2431465a+3:2398:x1874182575082752:12345-192.168.206.11@tcp:39:umount.0 Request processed in 660us (1180us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787360151.141536:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 261 00000100:00100000:1.0:1787360151.194208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360151.194423:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083008 00000100:00100000:3.0:1787360151.194433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083008 00000100:00100000:3.0:1787360151.194480:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 401 00000100:00100000:3.0:1787360151.194491:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+7:2398:x1874182575083008:12345-192.168.206.11@tcp:251:umount.0 00000020:00000080:3.0:1787360151.194534:0:6524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff53 00000020:00010000:3.0:1787360151.194542:0:6524:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998903849800: total 0 00000100:00080000:3.0:1787360151.194547:0:6524:0:(import.c:65:import_set_state_nolock()) ffff99890384b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787360151.194698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a31033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:89778f7a-f278-4db1-8669-35e9fc15f33b+3:2398:x1874182575083008:12345-192.168.206.11@tcp:251:umount.0 Request processed in 208us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360151.194706:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 401 00000020:00010000:2.0:1787360151.198497:0:7473:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998903849800: total 0 00010000:00010000:3.0:1787360151.198880:0:7473:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998903849800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787360151.198925:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041c00/0x359a4e2aee72002c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4eef13 expref: 2 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360151.198946:0:7473:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998903849800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787360151.198958:0:7473:0:(genops.c:885:class_export_put()) final put ffff998903849800/89778f7a-f278-4db1-8669-35e9fc15f33b 00010000:00010000:3.0:1787360151.198980:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360151.198983:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360151.198985:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787360151.199049:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998903849800/89778f7a-f278-4db1-8669-35e9fc15f33b for MGS 00000020:00000080:0.0:1787360151.199091:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99890384b800 for MGS 00010000:00010000:2.0:1787360151.674590:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360151.805336:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360151.805357:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596100736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360151.805514:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360151.805851:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100736 00000100:00100000:3.0:1787360151.805860:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100736 00000100:00100000:3.0:1787360151.805910:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787360151.805919:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596100736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360151.805950:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787360151.805999:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596100736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360151.806005:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787360151.806046:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596100736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787360152.697432:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360152.826402:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360152.826425:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596100864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360152.826494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360152.826625:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100864 00000100:00100000:0.0:1787360152.826644:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100864 00000100:00100000:0.0:1787360152.826701:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787360152.826711:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596100864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360152.826738:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787360152.830158:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360152.830191:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596100992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360152.831119:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596100864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4404us (4619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360152.831133:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787360152.831173:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360152.831414:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596100864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360152.841105:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360152.842129:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596100992 00000100:00100000:2.0:1787360152.842139:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596100992 00000100:00100000:2.0:1787360152.842209:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787360152.842220:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596100992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360152.842257:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1787360152.842299:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360152.842344:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596100992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360152.842351:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787360152.842399:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3ff44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596100992:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1787360152.960257:0:15217:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787360152.986559:0:15217:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787360152.986614:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.986640:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.986647:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.986653:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.986675:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787360152.986680:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787360152.986707:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360152.986711:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787360152.986717:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787360152.986741:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a0ffae000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787360152.986770:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596101120:0@lo:39:umount.0 00000100:00100000:2.0:1787360152.986840:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360152.986937:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360152.986944:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.986952:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360152.986955:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.988671:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360152.988687:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360152.988693:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360152.988696:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787360152.988699:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787360152.988736:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.988742:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787360152.988841:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596101248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360152.988850:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.988865:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680a00/0x359a4e2aee71fffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720002 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.988878:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.988880:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.988882:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360152.988912:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360152.988953:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101120 00000100:00100000:0.0:1787360152.988959:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101120 00000100:00100000:3.0:1787360152.989155:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101248 00000100:00100000:3.0:1787360152.989160:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101248 00000100:00100000:3.0:1787360152.989203:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360152.989211:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3661:x1874182596101248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360152.989222:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360152.989256:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040c00/0x359a4e2aee720002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fffb expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.989268:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360152.989310:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3661:x1874182596101248:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360152.989317:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787360152.989337:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596101248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360152.989410:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787360152.989417:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874182596101120:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787360152.989437:0:6531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb6a 00000100:00080000:0.0:1787360152.989446:0:6531:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c7000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787360152.989514:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3ff44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3657:x1874182596101120:12345-0@lo:39:umount.0 Request processed in 98us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360152.989521:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1787360152.989527:0:6531:0:(genops.c:885:class_export_put()) final put ffff998a3c9c1000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787360152.989654:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787360152.989671:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a0ffae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787360152.989687:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596101120:0@lo:39:umount.0 00000020:00000080:2.0:1787360152.989736:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c9c1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1787360152.989759:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360152.989762:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787360152.989767:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787360152.989785:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c9c7000 for lustre-MDT0000 00010000:00010000:2.0:1787360152.990723:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990741:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990748:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990755:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990803:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360152.990810:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990816:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990822:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.990845:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.990984:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360152.990991:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.990998:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360152.991002:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991016:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360152.991023:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360152.991029:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360152.991031:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787360152.991176:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991182:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787360152.991247:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596101376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360152.991301:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360152.991382:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991390:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680400/0x359a4e2aee720009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee720010 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991401:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360152.991404:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991410:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360152.991413:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991419:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360152.991425:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360152.991437:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360152.991439:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787360152.991452:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991458:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787360152.991485:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360152.991492:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596101504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360152.991514:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360152.991542:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101376 00000100:00100000:1.0:1787360152.991547:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101376 00000100:00100000:1.0:1787360152.991585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101504 00000100:00100000:1.0:1787360152.991589:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101504 00000100:00100000:1.0:1787360152.991610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360152.991618:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+24:3658:x1874182596101376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360152.991644:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360152.991659:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350ab600/0x359a4e2aee720010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720009 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.991671:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360152.991704:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+23:3658:x1874182596101376:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360152.991710:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360152.991727:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787360152.991733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+22:3658:x1874182596101504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360152.991746:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360152.991756:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01516200/0x359a4e2aee71ff14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ff0d expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.991765:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360152.991788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3658:x1874182596101504:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360152.991794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787360152.991828:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596101504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360152.991836:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596101376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360152.991886:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.991896:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.991897:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.991899:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360152.992172:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360152.992179:0:15217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680600/0x359a4e2aee71ff0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ff14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360152.992190:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787360152.992198:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992205:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992212:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992219:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.992335:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360152.992340:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.992347:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360152.992350:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.992357:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360152.992364:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360152.992370:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787360152.992372:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787360152.992389:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.992406:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787360152.992452:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596101632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360152.992486:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360152.992531:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.992540:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.992542:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.992543:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360152.992580:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360152.992585:0:15217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35041400/0x359a4e2aee720263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72026a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360152.992595:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787360152.992602:0:15217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992610:0:15217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992624:0:15217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992647:0:15217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360152.992658:0:15217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787360152.992662:0:15217:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787360152.992665:0:15217:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787360152.992698:0:15217:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787360152.992702:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787360152.992706:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360152.992711:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1787360152.992717:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99890384e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360152.992723:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a2f247800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360152.992727:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a3c826800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360152.992732:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff998a3c821000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1787360152.992739:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998902a58000 bd1197f3-ef26-42bb-9c8a-916d2431465a 192.168.206.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360152.992744:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff998903b18000 1121de3d-8714-4863-bc5d-127112ba378a 192.168.206.11@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787360152.992749:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff998a3bac99b8) has exports, disconnecting them 00000020:00080000:2.0:1787360152.992753:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99890384e000), last request at 1787360150 00000020:00000080:2.0:1787360152.992758:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe7a 00000100:00080000:2.0:1787360152.992773:0:15217:0:(import.c:65:import_set_state_nolock()) ffff99890384f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787360152.992809:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99890384e000): rc 0 00000020:00000080:2.0:1787360152.992811:0:15217:0:(genops.c:885:class_export_put()) final put ffff99890384e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787360152.992826:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a2f247800), last request at 1787360150 00000020:00000080:2.0:1787360152.992830:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fd54 00000100:00080000:2.0:1787360152.992835:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a2f240000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787360152.992842:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a2f247800): rc 0 00000020:00000080:2.0:1787360152.992844:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2f247800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1787360152.992848:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a3c826800), last request at 1787359916 00000020:00000080:2.0:1787360152.992850:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc51 00000100:00080000:2.0:1787360152.992853:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a3c825800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787360152.992858:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a3c826800): rc 0 00000020:00000080:2.0:1787360152.992860:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a3c826800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1787360152.992864:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff998a3c821000), last request at 1787359916 00000020:00000080:2.0:1787360152.992867:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc19 00000100:00080000:2.0:1787360152.992869:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a10f49000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787360152.992875:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1787360152.992939:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a3c821000): rc 0 00000004:00000080:2.0:1787360152.992945:0:15217:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4f787a8bae0 00000100:00080000:2.0:1787360152.992960:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787360152.992963:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1787360152.993965:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787360152.993991:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787360152.994253:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101632 00000100:00100000:1.0:1787360152.994261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101632 00000100:00100000:1.0:1787360152.994311:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787360152.994320:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+21:3660:x1874182596101632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360152.994332:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360152.994348:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350aa600/0x359a4e2aee72026a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720263 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.994366:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360152.994394:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360152.994401:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.994409:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680e00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360152.994413:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.994421:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360152.994428:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360152.994433:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3660:x1874182596101632:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1946us total) trans 0 rc 0/0 10000000:01000000:3.0:1787360152.994434:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360152.994436:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787360152.994439:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1787360152.994441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1787360152.994459:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.994466:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360152.994483:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.994506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680e00/0x359a4e2aee71fac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fad0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360152.994515:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.994517:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360152.994518:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787360152.994527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99890384e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:2.0:1787360152.994549:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787360152.994553:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1787360152.994564:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1787360152.994568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2f247800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787360152.994587:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c826800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787360152.994609:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99890384f000 for lustre-MDT0000 00000020:00000080:3.0:1787360152.994612:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2f240000 for lustre-MDT0000 00000020:00000080:3.0:1787360152.994615:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3c825800 for lustre-MDT0000 00000100:00080000:2.0:1787360152.994626:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787360152.994647:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787360152.994649:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596101760:0@lo:39:umount.0 00000100:00080000:2.0:1787360152.994653:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787360152.994655:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1787360152.994662:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360152.994687:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360152.994713:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596102016:0@lo:9:umount.0 00000100:00080000:2.0:1787360152.994726:0:15217:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787360152.994735:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360152.994735:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a2ecd7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787360152.994752:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596102144:0@lo:9:umount.0 00000020:00080000:2.0:1787360152.994766:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff998a3bac99b8) has no exports 00000100:00100000:3.0:1787360152.994769:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360152.994791:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101760 00000100:00100000:3.0:1787360152.994795:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101760 00000100:00100000:3.0:1787360152.994823:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787360152.994829:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596101760:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787360152.994851:0:6537:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fcac 00000100:00080000:3.0:1787360152.994858:0:6537:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360152.994876:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787360152.994918:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360152.994923:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360152.994931:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360152.995003:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3657:x1874182596101760:12345-0@lo:39:umount.0 Request processed in 173us (315us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787360152.995028:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1787360152.995033:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787360152.995187:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102016 00000100:00100000:1.0:1787360152.995192:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102016 00000100:00100000:1.0:1787360152.995257:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102144 00000100:00100000:1.0:1787360152.995261:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102144 00000100:00100000:1.0:1787360152.995288:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787360152.995294:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596102016:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787360152.995309:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fdfc 00000100:00080000:1.0:1787360152.995314:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998902a5b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787360152.995345:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787360152.995393:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787360152.995401:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1874182596102144:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787360152.995413:0:8447:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff3e 00000100:00080000:3.0:1787360152.995418:0:8447:0:(import.c:65:import_set_state_nolock()) ffff998a2ecd5800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787360152.995427:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3657:x1874182596102016:12345-0@lo:9:umount.0 Request processed in 134us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360152.995434:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000001:00000004:3.0:1787360152.995447:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:1.0:1787360152.995453:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360152.995468:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596101888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360152.995497:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360152.995515:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3657:x1874182596102144:12345-0@lo:9:umount.0 Request processed in 115us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360152.995521:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787360152.995531:0:7474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596101888 00010000:00010000:3.0:1787360152.995534:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360152.995535:0:7474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596101888 00000100:00100000:1.0:1787360152.995569:0:7474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787360152.995575:0:7474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3bad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+20:3661:x1874182596101888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360152.995584:0:7474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360152.995598:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688000/0x359a4e2aee71fad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fac9 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360152.995610:0:7474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360152.995670:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596101760:0@lo:39:umount.0 00000100:00080000:2.0:1787360152.995747:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ecd7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787360152.995756:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787360152.995758:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360152.995760:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596102144:0@lo:9:umount.0 00000100:00080000:2.0:1787360152.995771:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787360152.995777:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787360152.995779:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360152.995780:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596102016:0@lo:9:umount.0 00000100:00100000:1.0:1787360152.995850:0:7474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3bad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3f976a1-9d05-40f0-9d87-e3c95a944c03+19:3661:x1874182596101888:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360152.995857:0:7474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787360152.995908:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360152.997127:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3660:1874182596101632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360152.999677:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596101888:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787360153.004462:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff998a3bac99b8) has no exports 00000020:00000080:3.0:1787360153.067548:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb24 00000020:00000080:3.0:1787360153.067563:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a3c81e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787360153.067584:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787360153.067609:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c81e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787360153.070059:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360153.070078:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360153.070083:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff998a189f4d28) has no exports 00000020:00000080:0.0:1787360153.070556:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb1d 00000020:00000080:0.0:1787360153.070564:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2dff1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787360153.070604:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2dff1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787360153.070621:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360153.070637:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787360153.070640:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2dff0000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787360153.070642:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2dff0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787360153.070650:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787360153.721615:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787360153.852520:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787360153.852536:0:6511:0:(genops.c:885:class_export_put()) final put ffff998a3c821000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787360153.852634:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000020:00000080:2.0:1787360153.852636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c821000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00080000:1.0:1787360153.852642:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1787360153.852645:0:6511:0:(genops.c:885:class_export_put()) final put ffff998902a58000/bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00100000:1.0:1787360153.852662:0:6511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000001:00080000:1.0:1787360153.852665:0:6511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1787360153.852672:0:6511:0:(genops.c:885:class_export_put()) final put ffff998903b18000/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:2.0:1787360153.852694:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a10f49000 for lustre-MDT0000 00000020:00000080:2.0:1787360153.852896:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a58000/bd1197f3-ef26-42bb-9c8a-916d2431465a for lustre-MDT0000 00000020:00000080:2.0:1787360153.852934:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998903b18000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-MDT0000 00000020:00000080:2.0:1787360153.852961:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a5e000 for lustre-MDT0000 00000020:00000080:2.0:1787360153.852968:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903b1d000 for lustre-MDT0000 00010000:00010000:3.0:1787360154.745397:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787360154.877153:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360154.877175:0:9528:0:(genops.c:885:class_export_put()) final put ffff998a2ecd2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787360154.877197:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:2.0:1787360154.877207:0:9528:0:(genops.c:885:class_export_put()) final put ffff998a1a516000/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:3.0:1787360154.877345:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787360154.877406:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a1a516000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-OST0001 00000020:00000080:3.0:1787360154.877422:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ecd5800 for lustre-OST0001 00000020:00000080:3.0:1787360154.877426:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a1a511000 for lustre-OST0001 00000001:00100000:3.0:1787360154.884520:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787360154.884530:0:8442:0:(genops.c:885:class_export_put()) final put ffff998a3c9c4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787360154.884559:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:3.0:1787360154.884562:0:8442:0:(genops.c:885:class_export_put()) final put ffff998a3784b000/1121de3d-8714-4863-bc5d-127112ba378a 00000001:00100000:1.0:1787360154.884670:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787360154.884679:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1787360154.884683:0:7462:0:(genops.c:885:class_export_put()) final put ffff998a2ed9d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787360154.884688:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00080000:1.0:1787360154.884694:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1787360154.884696:0:7462:0:(genops.c:885:class_export_put()) final put ffff998902a5f800/bd1197f3-ef26-42bb-9c8a-916d2431465a 00000001:00100000:1.0:1787360154.884701:0:7462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1121de3d-8714-4863-bc5d-127112ba378a 00000001:00080000:1.0:1787360154.884704:0:7462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1787360154.884706:0:7462:0:(genops.c:885:class_export_put()) final put ffff99890373d000/1121de3d-8714-4863-bc5d-127112ba378a 00000020:00000080:2.0:1787360154.884862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c9c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787360154.884929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3784b000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-OST0000 00000020:00000080:2.0:1787360154.884951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787360154.884983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5f800/bd1197f3-ef26-42bb-9c8a-916d2431465a for lustre-MDT0001 00000020:00000080:2.0:1787360154.885004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99890373d000/1121de3d-8714-4863-bc5d-127112ba378a for lustre-MDT0001 00000020:00000080:2.0:1787360154.885027:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a5b800 for lustre-OST0000 00000020:00000080:2.0:1787360154.885032:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3784d800 for lustre-OST0000 00000020:00000080:2.0:1787360154.885035:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed9c800 for lustre-MDT0001 00000020:00000080:2.0:1787360154.885039:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a59000 for lustre-MDT0001 00000020:00000080:2.0:1787360154.885042:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99890373c000 for lustre-MDT0001 00000020:01000000:0.0:1787360155.129439:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989036772a0 - data ffff998a29f12360/ffff998903a82400 00000020:01000000:0.0:1787360155.129597:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a0fb0e0c0 - data ffff998a29d83438/ffff998a2dfe5000 00000001:00000004:0.0:1787360155.136105:0:15217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1787360155.199696:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787360155.199707:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787360155.199725:0:15217:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99890394bb80 x1874182596101760/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787360162 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360155.199759:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787360155.206370:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787360155.206380:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787360155.206400:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360155.206403:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787360155.209469:0:8768:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787360155.209481:0:8768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787360155.209502:0:8768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787360155.211289:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787360155.211310:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1787360155.211332:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787360155.211354:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787360155.211964:0:9855:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787360155.211971:0:9855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787360155.211986:0:9855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787360155.216480:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71faec 00000020:00000080:2.0:1787360155.216499:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f14000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787360155.217220:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f14000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360155.219428:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb01 00000020:00000080:2.0:1787360155.219450:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f13000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787360155.219464:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787360155.219475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f13000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787360155.219487:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360155.219498:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787360155.219716:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff998a3bacb370) has no exports 00000004:01000000:2.0:1787360155.220003:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787360155.220015:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff37 00000020:00000080:2.0:1787360155.220021:0:15217:0:(genops.c:885:class_export_put()) final put ffff99890384a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787360155.220034:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787360155.220063:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360155.220075:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787360155.220078:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9989034d0000) has no exports 00000020:00000080:2.0:1787360155.220085:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff30 00000020:00000080:2.0:1787360155.220099:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2ecd0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787360155.220556:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99890384a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787360155.220573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787360155.221017:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787360155.221023:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787360155.221029:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1787360155.221036:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360155.221039:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360155.221100:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ecd7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787360155.221150:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360155.221162:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360155.221167:0:15217:0:(genops.c:885:class_export_put()) final put ffff9989036e2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360155.221170:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787360155.221175:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360155.221787:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fdf5 00000020:00000080:2.0:1787360155.221797:0:15217:0:(genops.c:885:class_export_put()) final put ffff9989029fe800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787360155.221989:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787360155.221995:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360155.222004:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787360155.222008:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9989027399b8) has no exports 00000020:00000080:2.0:1787360155.222016:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fdee 00000020:00000080:2.0:1787360155.222021:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2ed5a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787360155.222054:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9989029fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1787360155.222708:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787360155.222715:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787360155.222719:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1787360155.222726:0:15217:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360155.222729:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360155.223133:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed5a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360155.223270:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360155.223283:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787360155.223473:0:15217:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787360155.223488:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fca5 00000020:00000080:2.0:1787360155.223562:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2ee3c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360155.223596:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed5f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787360155.223603:0:36:0:(genops.c:885:class_export_put()) final put ffff998a2ecd6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360155.223606:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787360155.223611:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787360155.223792:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787360155.223798:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360155.223828:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787360155.223833:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff998a3c9019b8) has no exports 00000020:00000080:2.0:1787360155.223840:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc9e 00000020:00000080:2.0:1787360155.223850:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a2ed9e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787360155.223938:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ee3c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787360155.225439:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed9e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787360155.226488:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787360155.226495:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787360155.226501:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1787360155.226511:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360155.226589:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.226605:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787360155.226661:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.226665:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787360155.226673:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a03953000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787360155.226677:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a03953000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787360155.226694:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787360155.226952:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb08 00000020:00000080:3.0:1787360155.226964:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f15800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787360155.226996:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787360155.227001:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360155.227032:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed9a000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787360155.227043:0:36:0:(genops.c:885:class_export_put()) final put ffff998a2dff3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360155.227050:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2dff3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787360155.227055:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360155.227115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f15800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787360155.227166:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787360155.227172:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff998a3baccd28) has no exports 00000020:00000080:3.0:1787360155.227200:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.227204:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787360155.227207:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f11000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787360155.227209:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f11000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787360155.227213:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787360155.227542:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb0f 00000020:00000080:3.0:1787360155.227549:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f12000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787360155.227569:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a0ffaa800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787360155.227573:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a0ffaa800 3 00000020:01000004:3.0:1787360155.227577:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a0ffaa800 from lustre-MDT0000 00000020:00000080:3.0:1787360155.227602:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.227630:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787360155.227634:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f13800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787360155.227637:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f13800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787360155.227645:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787360155.227677:0:15217:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787360155.227682:0:15217:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787360155.227685:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787360155.227687:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360155.227691:0:15217:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787360155.227698:0:15217:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff998a1062e800 a3f976a1-9d05-40f0-9d87-e3c95a944c03 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787360155.227704:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff998a28e4b370) has exports, disconnecting them 00000020:00080000:3.0:1787360155.227709:0:15217:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff998a1062e800), last request at 1787359896 00000020:00000080:3.0:1787360155.227727:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71faad 00000020:00010000:3.0:1787360155.227731:0:15217:0:(genops.c:1921:obd_stale_export_put()) Put export ffff998a1062e800: total 1 00000100:00080000:3.0:1787360155.227735:0:15217:0:(import.c:65:import_set_state_nolock()) ffff998a1062a000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787360155.227748:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a1062e800): rc 0 00000020:00080000:3.0:1787360155.227752:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff998a28e4b370) has no exports 00000020:00010000:1.0:1787360155.227894:0:6519:0:(genops.c:1907:obd_stale_export_get()) Get export ffff998a1062e800: total 1 00010000:00010000:1.0:1787360155.227923:0:6519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff998a1062e800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787360155.227964:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350aae00/0x359a4e2aee71ffca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffc3 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.227982:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71200/0x359a4e2aee71ffd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffd1 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228001:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681a00/0x359a4e2aee71ffe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffdf expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228029:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35041600/0x359a4e2aee71fff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffed expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228041:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697800/0x359a4e2aee71fba9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fba2 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228062:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01688c00/0x359a4e2aee71fbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fbb0 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228076:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a35040000/0x359a4e2aee720240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720239 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228088:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350aa800/0x359a4e2aee72024e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720247 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228099:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a350abe00/0x359a4e2aee71ffbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffb5 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696c00/0x359a4e2aee71fece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71fec7 expref: 5 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228125:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681000/0x359a4e2aee72001e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720017 expref: 4 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228140:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a06681e00/0x359a4e2aee71ffae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee71ffa7 expref: 3 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228154:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70400/0x359a4e2aee72025c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x359a4e2aee720255 expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360155.228179:0:6519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff998a1062e800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787360155.228197:0:6519:0:(genops.c:885:class_export_put()) final put ffff998a1062e800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 00010000:00010000:1.0:1787360155.228204:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360155.228207:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360155.228209:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360155.228217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f12000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787360155.228243:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a1062e800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 for MGS 00000020:00000080:1.0:1787360155.228283:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a1062a000 for MGS 00000100:00100000:3.0:1787360155.228483:0:6524:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff998a3baad800:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1787360155.228676:0:6525:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff998a31038200:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1787360155.228749:0:6526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff998a31038c00:6526] 2 exiting: rc = 0 00000100:00100000:3.0:1787360155.229681:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229696:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229707:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229718:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229727:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229736:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229744:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229749:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229756:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229787:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229795:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229801:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229808:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229906:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229913:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229929:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229935:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229941:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229947:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229954:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229966:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229973:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229983:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229990:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.229998:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230004:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230011:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230018:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230025:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230031:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230036:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230042:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230048:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230052:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230057:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230063:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230069:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230075:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230081:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230086:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230091:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230097:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230103:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230110:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230116:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230122:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230132:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230138:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230143:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230148:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230166:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230172:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230178:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230184:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230190:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230196:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230202:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230208:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230215:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230222:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230627:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230634:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230640:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360155.230646:0:15217:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787360155.233771:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989037c4b40 - data ffff998a29f111b0/ffff998a3feaac00 00000020:01000000:3.0:1787360155.233991:0:15217:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a04f266c0 - data ffff998a29c330d8/ffff998a28ec2800 00000020:00000080:3.0:1787360155.240222:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fa91 00000020:00000080:3.0:1787360155.240259:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a1062b000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787360155.240281:0:15217:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a0ffaa800 from MGS, refs=2 00000020:01000004:3.0:1787360155.240285:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a0ffaa800 2 00000020:01000004:3.0:1787360155.240288:0:15217:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a0ffaa800 from MGS 00000020:00000080:3.0:1787360155.240314:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.240323:0:15217:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787360155.240326:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a1062d800/MGS 00000020:00000080:3.0:1787360155.240329:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a1062d800/MGS for MGS 00000020:01000000:3.0:1787360155.240337:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787360155.240427:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787360155.240431:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360155.240438:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787360155.240447:0:15217:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff998a28e7c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787360155.240454:0:15217:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff998a3c903370) has exports, disconnecting them 00000020:00080000:3.0:1787360155.240459:0:15217:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff998a28e7c800), last request at 1787359897 00000020:00000080:3.0:1787360155.240464:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb5c 00000020:00080000:3.0:1787360155.240490:0:15217:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a28e7c800): rc 0 00000020:00000080:3.0:1787360155.240495:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a28e7c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787360155.240968:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a1062b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787360155.240980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff998a28e7c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787360155.243876:0:15217:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787360155.243888:0:15217:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360155.243894:0:15217:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787360155.243902:0:15217:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360155.244092:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a0ffae000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787360155.244181:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360155.244192:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787360155.244199:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a08f16800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787360155.244204:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f16800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787360155.244266:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787360155.244380:0:15217:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a0ffaa800 1 00000020:00000080:2.0:1787360155.244388:0:15217:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fa83 00000020:00000080:2.0:1787360155.244397:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a10628000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787360155.244412:0:15217:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787360155.244417:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360155.244423:0:15217:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1787360155.244423:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a10628000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1787360155.244430:0:15217:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff998a189f3370) has no exports 00000020:00000080:3.0:1787360155.440355:0:15217:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360155.440372:0:15217:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787360155.440378:0:15217:0:(genops.c:885:class_export_put()) final put ffff998a0ffa9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787360155.440384:0:15217:0:(genops.c:844:class_export_destroy()) destroying export ffff998a0ffa9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787360155.440397:0:15217:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787360155.440610:0:15217:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998a0ffa8800 00000020:02000400:3.0:1787360155.440694:0:15217:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787360155.769851:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360155.903628:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596102400:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.903727:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.903801:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596102912:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.903829:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.903862:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787360155.903869:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596102272:0@lo:400:kworker.0 00000400:00000100:1.0:1787360155.903889:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596102272 offset 0 length 224: 4 00000100:00100000:1.0:1787360155.903905:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596102784:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.903929:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.903945:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596103296:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.903965:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.903990:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596102528:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.904044:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596103040:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.904085:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787360155.904090:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596102656:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904111:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.904126:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596103168:0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904146:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.904183:0:7862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102400 00000100:00100000:1.0:1787360155.904193:0:7862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102400 00000100:00100000:1.0:1787360155.904284:0:7862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787360155.904293:0:7862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3659:x1874182596102400:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787360155.904303:0:7862:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787360155.904349:0:7862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3659:x1874182596102400:12345-0@lo:400:kworker.0 Request processed in 55us (622us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360155.904357:0:7862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787360155.904384:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102912 00000100:00100000:1.0:1787360155.904388:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102912 00000100:00100000:1.0:1787360155.904429:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103296 00000100:00100000:1.0:1787360155.904433:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103296 00000100:00100000:1.0:1787360155.904457:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360155.904465:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596102912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904510:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596102912:12345-0@lo:400:kworker.0 Request processed in 46us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360155.904516:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787360155.904530:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787360155.904537:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904575:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596103296:12345-0@lo:400:kworker.0 Request processed in 39us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360155.904582:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787360155.904607:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102784 00000100:00100000:1.0:1787360155.904622:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102784 00000100:00100000:1.0:1787360155.904645:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102528 00000100:00100000:1.0:1787360155.904648:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102528 00000100:00100000:1.0:1787360155.904656:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103040 00000100:00100000:1.0:1787360155.904658:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103040 00000100:00100000:1.0:1787360155.904665:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596102656 00000100:00100000:1.0:1787360155.904667:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596102656 00000100:00100000:1.0:1787360155.904673:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103168 00000100:00100000:1.0:1787360155.904675:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103168 00000100:00100000:1.0:1787360155.904689:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787360155.904696:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904728:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596102784:12345-0@lo:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360155.904735:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787360155.904746:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787360155.904752:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360155.904781:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596103168:12345-0@lo:400:kworker.0 Request processed in 30us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360155.904788:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1787360155.904800:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787360155.904804:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596102528:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787360155.904809:0:9449:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787360155.904829:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890492f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596102528:12345-0@lo:400:kworker.0 Request processed in 24us (802us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360155.904845:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787360155.904857:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787360155.904861:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596103040:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787360155.904866:0:9449:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787360155.904887:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596103040:12345-0@lo:400:kworker.0 Request processed in 25us (821us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360155.904893:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787360155.904902:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787360155.904906:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596102656:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787360155.904910:0:9449:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787360155.904930:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3660:x1874182596102656:12345-0@lo:400:kworker.0 Request processed in 23us (819us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360155.904936:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1787360155.904965:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360155.904970:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360155.904972:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360155.905026:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787360155.905032:0:3660:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787360155.905037:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787360155.908067:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360155.908098:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596103424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360155.908198:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360155.908447:0:13819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103424 00000100:00100000:0.0:1787360155.908458:0:13819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103424 00000100:00100000:0.0:1787360155.908539:0:13819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787360155.908564:0:13819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596103424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360155.908602:0:13819:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787360155.908673:0:13819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596103424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360155.908680:0:13819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787360155.908736:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596103424:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787360155.909347:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff998904916300 x1874182596102784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360155.909361:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596102784:0@lo:400:kworker.0 00000100:00100000:0.0:1787360155.909375:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596103296:0@lo:400:kworker.0 00000100:00080000:0.0:1787360155.909391:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787360155.909397:0:3659:0:(import.c:65:import_set_state_nolock()) ffff998a3456a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787360155.909402:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787360155.909410:0:3659:0:(import.c:65:import_set_state_nolock()) ffff998a3456a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360155.909414:0:3659:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1787360155.909422:0:3659:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff998a3456a000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360155.909451:0:3659:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddf480 x1874182596103552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360155.909487:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596102400:0@lo:400:kworker.0 00000100:00100000:0.0:1787360155.909507:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596102912:0@lo:400:kworker.0 00000100:00100000:2.0:1787360155.909631:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596103552:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787360155.909680:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360155.912496:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103552 00000100:00100000:0.0:1787360155.912514:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103552 00000100:00100000:0.0:1787360155.912598:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787360155.912608:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596103552:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1787360155.912649:0:6537:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787360155.912853:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596103552:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 244us (3171us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360155.912861:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1787360155.912916:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3456a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360155.912922:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360155.912927:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596103552:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1787360155.938437:0:3660:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360155.938455:0:3660:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 214 00000100:00080000:1.0:1787360155.938467:0:3660:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99890263c000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360155.939337:0:3660:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddf480 x1874182596103680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360155.939382:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596102656:0@lo:400:kworker.0 00010000:00080000:0.0:1787360155.939427:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff998904815f80 x1874182596103168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360155.939439:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596103168:0@lo:400:kworker.0 00000100:00080000:0.0:1787360155.939455:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787360155.939459:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998a3127d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787360155.939463:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787360155.939467:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998a3127d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360155.939470:0:3660:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1787360155.939476:0:3660:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998a3127d000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360155.939490:0:3660:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edde300 x1874182596103808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360155.939516:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596102528:0@lo:400:kworker.0 00000100:00080000:0.0:1787360155.939534:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787360155.939537:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787360155.939540:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787360155.939543:0:3660:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360155.939547:0:3660:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 237 00000100:00080000:0.0:1787360155.939551:0:3660:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360155.939563:0:3660:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddd500 x1874182596103936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360155.939571:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596103040:0@lo:400:kworker.0 00000100:00100000:2.0:1787360155.939747:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596103680:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787360155.940092:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360155.940214:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596103808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787360155.940344:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360155.940371:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596103936:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787360155.940394:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360155.940602:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103680 00000100:00100000:1.0:1787360155.940622:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103680 00000100:00100000:1.0:1787360155.940664:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103808 00000100:00100000:1.0:1787360155.940668:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103808 00000100:00100000:1.0:1787360155.940696:0:9449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596103936 00000100:00100000:1.0:1787360155.940699:0:9449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596103936 00000100:00100000:1.0:1787360155.940714:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787360155.940722:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596103680:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787360155.940745:0:9449:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787360155.941058:0:11098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787360155.941066:0:11098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596103808:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787360155.941078:0:11098:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360155.941498:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596103680:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 773us (1403us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360155.941507:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787360155.941531:0:9449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787360155.941536:0:9449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596103936:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1787360155.941549:0:9449:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360155.941576:0:9449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3657:x1874182596103936:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 39us (1181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360155.941581:0:9449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787360155.941699:0:11098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1874182596103808:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 631us (1353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360155.941706:0:11098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1787360155.941842:0:3657:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360155.941849:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360155.941852:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596103680:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787360155.941861:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3127d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360155.941864:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360155.941867:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596103808:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787360155.941875:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360155.941877:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360155.941879:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596103936:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787360156.793550:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360157.243389:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360157.818541:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360157.946083:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596104064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360157.946156:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360157.946407:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104064 00000100:00100000:2.0:1787360157.946415:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104064 00000100:00100000:2.0:1787360157.946483:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787360157.946493:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596104064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360157.946518:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787360157.946563:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596104064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360157.946572:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1787360157.946626:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360157.946665:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596104064:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787360158.841466:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787360158.850443:0:15418:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787360158.869959:0:15418:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787360158.870009:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.870023:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.870031:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.870038:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.870058:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787360158.870063:0:15418:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787360158.870088:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787360158.870093:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787360158.870099:0:15418:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787360158.870105:0:15418:0:(import.c:65:import_set_state_nolock()) ffff998a3127d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787360158.870110:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787360158.870112:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787360158.870129:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787360158.871954:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360158.871966:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.871977:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360158.871982:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.872005:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360158.872012:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360158.872017:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787360158.872020:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787360158.872022:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787360158.872059:0:7473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.872065:0:7473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360158.872096:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.872103:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35041200/0x359a4e2aee71ffdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71ffe6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.872117:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360158.872118:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360158.872120:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360158.872336:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596104192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360158.872401:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360158.872510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104192 00000100:00100000:0.0:1787360158.872517:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104192 00000100:00100000:0.0:1787360158.872559:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787360158.872645:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3661:x1874182596104192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787360158.872651:0:6518:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360158 with bad export cookie 3862485576719661741 00010000:00010000:3.0:1787360158.874047:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874062:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874070:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874077:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874135:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360158.874143:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874150:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874156:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.874161:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883093:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360158.883106:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883138:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360158.883142:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883153:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360158.883161:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360158.883167:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360158.883170:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1787360158.883208:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883215:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360158.883264:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680200/0x359a4e2aee71ffed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fff4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883286:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360158.883290:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883296:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360158.883300:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883318:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360158.883325:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360158.883330:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360158.883333:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1787360158.883346:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883352:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360158.883357:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360158.883365:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360158.883367:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360158.883368:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360158.883386:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596104320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360158.883447:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360158.883492:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360158.883499:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596104448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360158.883520:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360158.883551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104320 00000100:00100000:1.0:1787360158.883558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104320 00000100:00100000:1.0:1787360158.883587:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104448 00000100:00100000:1.0:1787360158.883590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104448 00000100:00100000:1.0:1787360158.883619:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360158.883626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3658:x1874182596104320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787360158.883638:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360158 with bad export cookie 3862485576719661741 00000100:00100000:1.0:1787360158.883679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3658:x1874182596104320:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (231us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360158.883686:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360158.883703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360158.883707:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3658:x1874182596104448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787360158.883711:0:6516:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360158 with bad export cookie 3862485576719661741 00000100:00100000:1.0:1787360158.883735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3658:x1874182596104448:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (214us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360158.883741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787360158.883774:0:3658:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787360158.883778:0:3658:0:(import.c:65:import_set_state_nolock()) ffff998a28e28800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787360158.883781:0:3658:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787360158.885069:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3661:x1874182596104192:12345-0@lo:103:ldlm_bl.0 Request processed in 12420us (12664us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787360158.885092:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787360158.885524:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787360158.885533:0:15418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee71fec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee71fece expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360158.885552:0:15418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787360158.885571:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.885580:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.885587:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.885594:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787360158.887346:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1787360158.887395:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360158.887403:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360158.887429:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787360158.887433:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360158.887443:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360158.887450:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360158.887457:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787360158.887460:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787360158.887513:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1787360158.887520:0:15418:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787360158.887529:0:15418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.887538:0:15418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.887546:0:15418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.887553:0:15418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360158.887566:0:15418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787360158.887569:0:15418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787360158.887572:0:15418:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787360158.887617:0:15418:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787360158.887622:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787360158.887630:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360158.887636:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787360158.887641:0:15418:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9989036e4800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787360158.887647:0:15418:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff998a2f244800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787360158.887652:0:15418:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff998a345519b8) has exports, disconnecting them 00000020:00080000:3.0:1787360158.887657:0:15418:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9989036e4800), last request at 1787360155 00000020:00000080:3.0:1787360158.887663:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe8f 00000100:00080000:3.0:1787360158.887678:0:15418:0:(import.c:65:import_set_state_nolock()) ffff9989036e5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787360158.887715:0:15418:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9989036e4800): rc 0 00000020:00000080:3.0:1787360158.887717:0:15418:0:(genops.c:885:class_export_put()) final put ffff9989036e4800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787360158.887728:0:15418:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff998a2f244800), last request at 1787360155 00000020:00000080:3.0:1787360158.887731:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fd69 00000100:00080000:3.0:1787360158.887736:0:15418:0:(import.c:65:import_set_state_nolock()) ffff998a2f245800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787360158.887745:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e4800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787360158.887784:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989036e5000 for lustre-MDT0001 00000020:00080000:3.0:1787360158.887795:0:15418:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a2f244800): rc 0 00000020:00000080:3.0:1787360158.887797:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a2f244800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787360158.887806:0:15418:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4f780d87ae0 00000020:00000080:3.0:1787360158.887816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2f244800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787360158.887833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2f245800 for lustre-MDT0001 00000100:00080000:3.0:1787360158.887851:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787360158.887855:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1787360158.888692:0:15418:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787360158.888699:0:15418:0:(import.c:65:import_set_state_nolock()) ffff998a3456a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787360158.904505:0:3658:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787360158.904510:0:3658:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787360158.904520:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904917800 x1874182596102272/t0(0) o400->MGC192.168.206.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787360171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360158.904546:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2edddc00 x1874182596104192/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360158.904557:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99890415b480 x1874182596104320/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360174 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360158.904565:0:3658:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998904158000 x1874182596104448/t0(0) o103->MGC192.168.206.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360174 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360158.904669:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3659:1874182596102272:0@lo:400:kworker.0 10000000:01000000:1.0:1787360158.904691:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787360158.904695:0:3658:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787360158.904696:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787360158.905144:0:3661:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff998a28e28800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787360158.905161:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3661:1874182596104192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360158.905651:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360158.905659:0:7473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.905669:0:7473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681200 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360158.905673:0:7473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.905683:0:7473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360158.905690:0:7473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360158.905695:0:7473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787360158.905698:0:7473:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787360158.905701:0:7473:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787360158.905715:0:7473:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:0.0:1787360158.905718:0:7473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.905725:0:7473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681200/0x359a4e2aee71fbb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71fbb7 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360158.905741:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360158.905759:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360158.905761:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360158.908581:0:6520:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360158.908606:0:6520:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787360158.908638:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360158.908646:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689200/0x359a4e2aee720255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x359a4e2aee72025c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360158.908665:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360158.908667:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360158.908669:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360158.909263:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a3f976a1-9d05-40f0-9d87-e3c95a944c03:0:1874182596104576:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787360158.910553:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787360158.910560:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787360158.910591:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787360158.910681:0:15418:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787360158.910703:0:15418:0:(import.c:65:import_set_state_nolock()) ffff9989029fd800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787360158.910725:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787360158.910727:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1787360158.910737:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787360158.910801:0:15418:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787360158.910810:0:15418:0:(import.c:65:import_set_state_nolock()) ffff998902a5d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787360158.910834:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff998a345519b8) has no exports 00000100:00100000:0.0:1787360158.912206:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596104704:0@lo:9:umount.0 00000100:00100000:0.0:1787360158.912302:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360158.912338:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596104832:0@lo:9:umount.0 00000100:00100000:0.0:1787360158.912359:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360158.912567:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104704 00000100:00100000:3.0:1787360158.912574:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104704 00000100:00100000:3.0:1787360158.912632:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596104832 00000100:00100000:3.0:1787360158.912636:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596104832 00000100:00100000:3.0:1787360158.912668:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360158.912677:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874182596104704:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787360158.912701:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fdb6 00000100:00080000:3.0:1787360158.912709:0:8770:0:(import.c:65:import_set_state_nolock()) ffff9989029f8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360158.912747:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787360158.912872:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3657:x1874182596104704:12345-0@lo:9:umount.0 Request processed in 196us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360158.912880:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360158.912895:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787360158.912903:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1874182596104832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787360158.912913:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71ff06 00000100:00080000:3.0:1787360158.912918:0:8770:0:(import.c:65:import_set_state_nolock()) ffff998903848000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360158.912938:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787360158.913007:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3657:x1874182596104832:12345-0@lo:9:umount.0 Request processed in 105us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360158.913028:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1787360158.913941:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360158.914676:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360158.915428:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787360158.915476:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989029fd800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787360158.915496:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787360158.915498:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787360158.915503:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596104704:0@lo:9:umount.0 00000100:00080000:0.0:1787360158.915518:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a5d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787360158.915530:0:3657:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787360158.915532:0:3657:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787360158.915534:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596104832:0@lo:9:umount.0 00000100:00080000:1.0:1787360158.915797:0:3658:0:(import.c:65:import_set_state_nolock()) ffff998a28e28800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360158.915816:0:3658:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 174 00000100:00080000:1.0:1787360158.915823:0:3658:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a28e28800 using connection 192.168.206.111@tcp/0@lo 00000100:00080000:1.0:1787360158.915833:0:6527:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360158.915869:0:3658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904159180 x1874182596104960/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360158.915907:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596104320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360158.915921:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3658:1874182596104448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360158.915964:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182596104960:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787360158.916020:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596104960 offset 0 length 520: 4 00000020:00080000:3.0:1787360158.926473:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff998a345519b8) has no exports 00000020:01000000:2.0:1787360158.976671:0:15418:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998902aa5ea0 - data ffff998a29f200d8/ffff998903951800 00000020:01000000:2.0:1787360158.976898:0:15418:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998a0ffecd80 - data ffff998a29de5870/ffff998a04f3a000 00000001:00000004:2.0:1787360158.988446:0:15418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1787360159.050306:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787360159.050315:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787360159.050323:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787360159.052343:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787360159.052350:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1787360159.052407:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360159.052410:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787360159.057519:0:8764:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787360159.057527:0:8764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1787360159.057537:0:8764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787360159.058580:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787360159.058839:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1787360159.058888:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360159.058891:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787360159.060700:0:9851:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787360159.060707:0:9851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787360159.060719:0:9851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787360159.062084:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fbd3 00000020:00000080:3.0:1787360159.062095:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787360159.063566:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787360159.063748:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fbe8 00000020:00000080:3.0:1787360159.063756:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787360159.063772:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787360159.063776:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360159.063783:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787360159.063787:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff998a34553370) has no exports 00000004:01000000:3.0:1787360159.063945:0:15418:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787360159.063952:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fef1 00000020:00000080:3.0:1787360159.063956:0:15418:0:(genops.c:885:class_export_put()) final put ffff9989036e5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787360159.063960:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787360159.063963:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360159.063970:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360159.063973:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9989034d4d28) has no exports 00000020:00000080:3.0:1787360159.063977:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71feea 00000020:00000080:3.0:1787360159.063980:0:15418:0:(genops.c:885:class_export_put()) final put ffff998902a5d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787360159.064190:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787360159.064202:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787360159.064209:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787360159.064746:0:15418:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787360159.064751:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787360159.064755:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1787360159.064760:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360159.064762:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787360159.064807:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360159.064816:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360159.064823:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fdaf 00000020:00000080:3.0:1787360159.064828:0:15418:0:(genops.c:885:class_export_put()) final put ffff998902638000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787360159.064833:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787360159.064838:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360159.064842:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360159.064844:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff998a28e48000) has no exports 00000020:00000080:3.0:1787360159.064849:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fda8 00000020:00000080:3.0:1787360159.064851:0:15418:0:(genops.c:885:class_export_put()) final put ffff9989029fa000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1787360159.065006:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902a5d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1787360159.065015:0:8:0:(genops.c:885:class_export_put()) final put ffff9989036e1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787360159.065018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989036e1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1787360159.065025:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360159.065118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998902638000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1787360159.065127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989029fa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787360159.067070:0:15418:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787360159.067077:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787360159.067080:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1787360159.067086:0:15418:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360159.067088:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360159.067651:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989029fd800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787360159.067915:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360159.067927:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787360159.067932:0:15418:0:(genops.c:885:class_export_put()) final put ffff998902615000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360159.067936:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998902615000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787360159.067944:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787360159.068042:0:15418:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787360159.068051:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc0b 00000020:00000080:3.0:1787360159.068059:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3d778000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787360159.068070:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787360159.068074:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360159.068079:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787360159.068083:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff998a34550000) has no exports 00000020:00000080:3.0:1787360159.068102:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc04 00000020:00000080:3.0:1787360159.068107:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787360159.068439:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d778000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787360159.068446:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787360159.075349:0:15418:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787360159.075366:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360159.075370:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787360159.075379:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360159.075437:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360159.075448:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360159.075514:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360159.075519:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360159.075524:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a08f11800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787360159.075529:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f11800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787360159.075536:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360159.075726:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fbef 00000020:00000080:0.0:1787360159.075734:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456b800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787360159.075739:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787360159.075743:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360159.075748:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360159.075751:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff998a34554d28) has no exports 00000020:00000080:0.0:1787360159.075769:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360159.075773:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787360159.075777:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fbf6 00000020:00000080:0.0:1787360159.075780:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456d000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787360159.075788:0:15418:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a10f4d000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787360159.075791:0:15418:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a10f4d000 2 00000020:01000004:0.0:1787360159.075794:0:15418:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a10f4d000 from lustre-MDT0001 00000020:00000080:0.0:1787360159.075820:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360159.075824:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787360159.075827:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3456f000/lustre-MDT0001_UUID 00000020:00000080:0.0:1787360159.075829:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456f000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787360159.075837:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787360159.075869:0:15418:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787360159.075873:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787360159.075876:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360159.075885:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360159.075891:0:15418:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff998a3c81a000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360159.075897:0:15418:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff998a28e499b8) has exports, disconnecting them 00000020:00080000:0.0:1787360159.075901:0:15418:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff998a3c81a000), last request at 1787359916 00000020:00000080:0.0:1787360159.075904:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fc4a 00000020:00080000:0.0:1787360159.075917:0:15418:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a3c81a000): rc 0 00000020:00000080:0.0:1787360159.075921:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3c81a000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787360159.076608:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3456a000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787360159.076617:0:14779:0:(genops.c:885:class_export_put()) final put ffff998a3d619000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787360159.076620:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3d619000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787360159.076625:0:14779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787360159.076717:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787360159.076721:0:14779:0:(genops.c:885:class_export_put()) final put ffff998a3456b000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787360159.076723:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787360159.076726:0:14779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787360159.076897:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3456d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787360159.076902:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c81a000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787360159.076939:0:15418:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787360159.076943:0:15418:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360159.076946:0:15418:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360159.076951:0:15418:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360159.076966:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a3127d000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787360159.077088:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360159.077094:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787360159.077097:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a3c81b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787360159.077099:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c81b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787360159.077103:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787360159.077137:0:15418:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a10f4d000 1 00000020:00000080:1.0:1787360159.077141:0:15418:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fb86 00000020:00000080:1.0:1787360159.077146:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a08f10800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787360159.077153:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787360159.077160:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a08f10800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787360159.077168:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360159.077172:0:15418:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360159.077175:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff998a189f0000) has no exports 00000020:00000080:1.0:1787360159.239953:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360159.240366:0:15418:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787360159.240372:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a10f4b800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787360159.240377:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998a10f4b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787360159.240388:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787360159.240496:0:15418:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998a10f4d800 00000020:01000000:1.0:1787360159.240516:0:15418:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787360159.240520:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360159.240524:0:15418:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360159.240527:0:15418:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff998a189f19b8) has no exports 00000100:00100000:3.0:1787360159.240751:0:6533:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff998a28ee7800:6533] 2 exiting: rc = 0 00000100:00100000:3.0:1787360159.240871:0:6531:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff998a0a851800:6531] 0 exiting: rc = 1 00000100:00100000:3.0:1787360159.240941:0:11098:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff998902b3c000:11098] 4 exiting: rc = 0 00000100:00100000:1.0:1787360159.241123:0:6532:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff998a0a851400:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1787360159.241428:0:9449:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99890293e400:9449] 3 exiting: rc = 0 00000100:00100000:1.0:1787360159.241526:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241545:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241551:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241557:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241562:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241567:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241573:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241578:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241584:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241589:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241607:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241614:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241620:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241624:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241629:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241635:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241640:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241645:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241650:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241655:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241660:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241666:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241671:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241676:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241681:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241686:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241691:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241697:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241702:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241707:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241713:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241784:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241794:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241798:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241803:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241809:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241821:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241839:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241846:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241850:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241855:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241860:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241865:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241870:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241875:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241880:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241884:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241889:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241894:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241898:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241903:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241909:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241915:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241920:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241925:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241930:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241935:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241941:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241947:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241953:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.241958:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.242145:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.242155:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.242169:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245398:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff998a06671000:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1787360159.245539:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff998a28ee7000:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1787360159.245642:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245649:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245656:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245661:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245668:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245674:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245691:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245696:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245702:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245707:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245713:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245719:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245739:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245745:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245751:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245763:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245768:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245774:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245779:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245784:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245789:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245794:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245799:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245805:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245810:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245816:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245821:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245827:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245833:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245839:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245844:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245849:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245854:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245860:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245865:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245870:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245875:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245881:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245887:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245893:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245906:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245912:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245917:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245923:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245928:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245934:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245939:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245945:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245950:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245955:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.245960:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246083:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246089:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246095:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246100:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246105:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246111:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246116:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246121:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246126:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246130:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246135:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246140:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.246575:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff998a02e30400:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1787360159.246731:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff998a02e31e00:6536] 0 exiting: rc = 1 00000100:00100000:3.0:1787360159.246906:0:7862:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff998a3c9bc600:7862] 2 exiting: rc = 0 00000100:00100000:1.0:1787360159.247065:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247073:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247080:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247086:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247092:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247098:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247104:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247109:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247116:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247122:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247128:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247146:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247152:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247173:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247181:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247187:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247192:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247197:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247203:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247208:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247214:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247219:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247262:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247269:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247275:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247295:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247302:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247309:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247315:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247322:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247328:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247335:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247341:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247347:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247353:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247359:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247365:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247387:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247396:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247402:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247409:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247416:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247422:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247427:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247433:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247439:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247453:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247459:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247465:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247484:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247490:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247496:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247502:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247508:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247514:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247520:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247526:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247532:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247538:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247544:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247550:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247556:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247563:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.247577:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258256:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff998a086cb200:6539] 1 exiting: rc = 0 00000100:00100000:0.0:1787360159.258402:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff998a02e42000:6538] 0 exiting: rc = 1 00000100:00100000:1.0:1787360159.258567:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258574:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258579:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258584:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258588:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258593:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258611:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258616:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258621:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258626:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258631:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258636:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258640:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258645:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258650:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258654:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258673:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258678:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258683:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258688:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258692:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258698:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258703:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258708:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258713:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258719:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258736:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258742:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258747:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258752:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258762:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258766:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258771:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258775:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258780:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258784:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258789:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258793:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258798:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258803:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258807:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258812:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258816:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258821:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258825:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258830:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258835:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258840:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258845:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258850:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258862:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258867:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258872:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258878:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258883:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258888:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258893:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258897:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258903:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258909:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258913:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258917:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.258923:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259274:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff998a086cb400:6540] 0 exiting: rc = 1 00000100:00100000:0.0:1787360159.259577:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff998a086caa00:6541] 1 exiting: rc = 0 00000100:00100000:1.0:1787360159.259671:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259677:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259682:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259688:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259693:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259698:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259703:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259709:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259715:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259732:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259739:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259743:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259748:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259753:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259762:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259766:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259771:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259776:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259781:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259786:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259801:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259806:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259810:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259816:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259820:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259825:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259830:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259836:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259841:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259845:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259850:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259855:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259860:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259866:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259871:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259877:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259881:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259886:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259890:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259895:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259900:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259905:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259910:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259915:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259919:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259924:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259929:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259934:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259940:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259944:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259949:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259954:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.259958:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260061:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260068:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260081:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260085:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260090:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260094:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260099:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260103:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260107:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360159.260112:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.261322:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff998a086ca600:6542] 0 exiting: rc = 1 00000100:00100000:1.0:1787360159.262512:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff998a02e43c00:6543] 1 exiting: rc = 0 00000100:00100000:0.0:1787360159.262918:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262925:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262931:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262936:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262942:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262947:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262953:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262958:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262972:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262978:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262983:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262988:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262993:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.262998:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263003:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263008:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263013:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263018:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263023:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263028:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263033:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263037:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263054:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263059:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263064:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263069:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263074:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263078:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263084:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263089:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263094:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263099:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263104:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263109:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263115:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263120:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263126:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263131:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263136:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263141:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263146:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263151:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263157:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263162:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263167:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263172:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263177:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263182:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263187:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263192:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263197:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263201:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263206:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263211:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263216:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263221:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263355:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263369:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263374:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263379:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263384:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263389:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263394:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360159.263399:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.264255:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff998a28ec9a00:6544] 0 exiting: rc = 1 00000100:00100000:1.0:1787360159.264478:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff998a3b9cee00:6545] 1 exiting: rc = 0 00000100:00100000:0.0:1787360159.264927:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff998a3b9cf400:6546] 2 exiting: rc = 0 00000100:00100000:2.0:1787360159.265175:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265181:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265186:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265192:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265203:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265210:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265215:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265220:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265319:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265326:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265331:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265336:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265341:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265347:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265353:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265358:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265364:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265369:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265373:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265378:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265383:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265388:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265393:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265398:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265404:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265409:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265415:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265421:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265426:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265632:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265649:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265654:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265659:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265665:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265669:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265675:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265680:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265686:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265691:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265697:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265701:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265707:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265712:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265717:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265733:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265740:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265746:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265752:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265757:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265763:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265768:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265774:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265779:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265799:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265807:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265813:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265818:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265823:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265829:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265834:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265839:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265844:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265850:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360159.265864:0:15418:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787360159.271080:0:15418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360159.271092:0:15418:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787360159.271097:0:15418:0:(genops.c:885:class_export_put()) final put ffff998a0ffae800/MDS_uuid 00000020:00000080:0.0:1787360159.271101:0:15418:0:(genops.c:844:class_export_destroy()) destroying export ffff998a0ffae800/MDS_uuid for MDS 00000020:01000000:0.0:1787360159.271107:0:15418:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787360159.271682:0:15418:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787360159.865420:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360160.889639:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787360161.017400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360161.017410:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360161.017413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360161.017417:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787360161.017430:0:8:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360161.017438:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1787360161.017444:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360161.017450:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99890263c000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360161.017486:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddc380 x1874182596105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360161.017559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360161.017563:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787360161.017564:0:8:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360161.017568:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 434 00000100:00100000:2.0:1787360161.017570:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596105088:0@lo:38:kworker.0 00000100:00080000:0.0:1787360161.017583:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360161.017597:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360161.017612:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddd880 x1874182596105344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1787360161.017627:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105088 offset 0 length 520: 4 00000100:00100000:2.0:1787360161.017697:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596105344:0@lo:38:kworker.0 00000400:00000100:2.0:1787360161.017717:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105344 offset 0 length 520: 4 00000100:00100000:3.0:1787360161.017791:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360161.017804:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596105216:0@lo:400:kworker.0 00000400:00000100:3.0:1787360161.017831:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105216 offset 0 length 224: 4 00000100:00100000:3.0:1787360161.017854:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360161.017863:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596105472:0@lo:400:kworker.0 00000400:00000100:3.0:1787360161.017883:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105472 offset 0 length 224: 4 00010000:00010000:0.0:1787360161.914604:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360162.937767:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787360163.409467:0:15618:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360163.441405:0:15618:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787360163.441457:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360163.441472:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360163.441480:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360163.441486:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360163.441506:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360163.441512:0:15618:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787360163.441542:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360163.441553:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddc380 x1874182596105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360163.441586:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360163.441592:0:15618:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360163.441598:0:15618:0:(import.c:65:import_set_state_nolock()) ffff99890263c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787360163.441602:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360163.441618:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddc380 x1874182596105088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360176 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360163.441635:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360163.441639:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:3.0:1787360163.442083:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360163.442090:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360163.442098:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680c00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360163.442101:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360163.442110:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360163.442118:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360163.442138:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360163.442141:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787360163.442144:0:6519:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787360163.442156:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:3.0:1787360163.442160:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360163.442168:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee71ffc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffca expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360163.442178:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360163.442180:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360163.442182:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360163.442309:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596105088:0@lo:38:kworker.0 00000100:00080000:0.0:1787360163.445108:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360163.445125:0:15618:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddf100 x1874182596105216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360177 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360163.445149:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360163.445155:0:15618:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787360163.445178:0:15618:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787360163.445286:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596105216:0@lo:400:kworker.0 00000100:00100000:2.0:1787360163.445290:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596105600:0@lo:39:umount.0 00000400:00000100:2.0:1787360163.445334:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105600 offset 0 length 224: 4 00010000:00010000:0.0:1787360163.961454:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787360164.025391:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360164.025400:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360164.025403:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360164.025406:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360164.025535:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360164.025555:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596105728:0@lo:400:kworker.0 00000400:00000100:1.0:1787360164.025615:0:3658:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105728 offset 0 length 224: 4 00000001:00100000:2.0:1787360164.604918:0:9528:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787360164.604926:0:9528:0:(genops.c:885:class_export_put()) final put ffff99890384c800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787360164.605063:0:8442:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787360164.605068:0:8442:0:(genops.c:885:class_export_put()) final put ffff9989029ff800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787360164.605143:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff99890384c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787360164.605188:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903848000 for lustre-OST0001 00000020:00000080:2.0:1787360164.605737:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9989029ff800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787360164.605911:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9989029f8000 for lustre-OST0000 00010000:00010000:0.0:1787360164.985585:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360166.009368:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360166.077446:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360166.077456:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360166.077459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360166.077462:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360166.077636:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596105856:0@lo:400:kworker.0 00000400:00000100:1.0:1787360166.077687:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596105856 offset 0 length 224: 4 00010000:00010000:0.0:1787360167.034133:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360168.060428:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360168.569324:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360158/real 1787360158] req@ffff998904159180 x1874182596104960/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787360168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360168.569358:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904159180 x1874182596104960/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787360168 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360168.569376:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a28e28800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360168.569402:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787360168.569406:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182596104960:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787360168.569562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360168.569567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787360168.569569:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a28e28800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360168.569574:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1787360168.569578:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360168.569592:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a28e28800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360168.569615:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddf800 x1874182596105984/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360168.569640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360168.569644:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360168.569794:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360168.569809:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596106112:0@lo:400:kworker.0 00000400:00000100:3.0:1787360168.569869:0:3660:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596106112 offset 0 length 224: 4 00000100:00100000:2.0:1787360168.570116:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182596105984:0@lo:250:kworker.0 00000400:00000100:2.0:1787360168.576623:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182596105984 offset 0 length 520: 4 00010000:00010000:3.0:1787360169.081530:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360170.105527:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360171.130888:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360172.154396:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360173.178204:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360173.689554:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360163/real 1787360163] req@ffff998a2eddc380 x1874182596105600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360173 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360173.689598:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2eddc380 x1874182596105600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360173 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360173.689620:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2ed5b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787360173.689644:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596105600:0@lo:39:umount.0 00000100:00080000:0.0:1787360173.691765:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360173.691777:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360173.691785:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787360173.694069:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.694092:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.694100:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.694107:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.694141:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360173.694149:0:15618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360173.695615:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360173.695631:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360173.695643:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350aac00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787360173.695647:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360173.695657:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360173.695665:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360173.695671:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360173.695674:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787360173.695691:0:6520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:2.0:1787360173.695695:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360173.695723:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a350aac00/0x359a4e2aee71ffd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffd8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360173.695744:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360173.695747:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360173.695749:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360173.696160:0:15618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.696168:0:15618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.696175:0:15618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360173.696204:0:15618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360173.696311:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360173.696325:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360173.696333:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a350ab000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360173.696336:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360173.696344:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360173.696351:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360173.696374:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787360173.696376:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787360173.696385:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:3.0:1787360173.696389:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360173.696397:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360173.696398:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360173.696400:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360173.700154:0:15618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a350ab000/0x359a4e2aee720247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72024e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360173.700180:0:15618:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787360173.700191:0:15618:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787360173.700193:0:15618:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787360173.700260:0:15618:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787360173.700266:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787360173.700353:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360173.700376:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360173.700381:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff998a28e4cd28) has no exports 00000020:00080000:1.0:1787360173.700416:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff998a28e4cd28) has no exports 00000020:01000000:1.0:1787360173.702315:0:15618:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989029d8a80 - data ffff998a29efd870/ffff998a2ef6bc00 00000020:01000000:1.0:1787360173.702503:0:15618:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff998902535660 - data ffff998a29e2a6c0/ffff998902871400 00100000:10000000:3.0:1787360173.716462:0:15618:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787360173.733644:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fd23 00000020:00000080:2.0:1787360173.733661:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a3127c800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787360173.733881:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3127c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787360173.733898:0:15618:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61e800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787360173.733902:0:15618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61e800 2 00000020:01000004:2.0:1787360173.733906:0:15618:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998a3d61e800 from lustre-OST0000 00000020:00000080:2.0:1787360173.736124:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360173.736147:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787360173.736155:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a3c81d800/lustre-OST0000_UUID 00000020:00000080:2.0:1787360173.736161:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff998a3c81d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787360173.736172:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787360173.736297:0:15618:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787360173.736304:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787360173.736308:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360173.736314:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787360173.736322:0:15618:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff998a2f243000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360173.736328:0:15618:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff998a3c904d28) has exports, disconnecting them 00000020:00080000:2.0:1787360173.736334:0:15618:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff998a2f243000), last request at 1787359936 00000020:00000080:2.0:1787360173.736340:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fd4d 00000020:00080000:2.0:1787360173.736357:0:15618:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a2f243000): rc 0 00000020:00000080:2.0:1787360173.736363:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a2f243000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787360173.737249:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2f243000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787360173.748121:0:15618:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787360173.748134:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360173.748146:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787360173.748156:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360173.748379:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99890263c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787360173.748563:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360173.748574:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787360173.748581:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a2eeb9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787360173.748585:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2eeb9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787360173.748595:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787360173.748684:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787360173.748688:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360173.748695:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360173.748704:0:15618:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff998a2ecd3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360173.748710:0:15618:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff99890273b370) has exports, disconnecting them 00000020:00080000:0.0:1787360173.748715:0:15618:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff998a2ecd3800), last request at 1787359936 00000020:00000080:0.0:1787360173.748719:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fd62 00000020:00080000:0.0:1787360173.748736:0:15618:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998a2ecd3800): rc 0 00000020:00000080:0.0:1787360173.748742:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a2ecd3800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787360173.748913:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787360173.749884:0:15618:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787360173.749892:0:15618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787360173.749909:0:15618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787360173.749916:0:15618:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360173.750105:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360173.750113:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787360173.750123:0:15618:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61e800 1 00000020:00000080:0.0:1787360173.750131:0:15618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fceb 00000020:00000080:0.0:1787360173.750147:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a2ee3a800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787360173.750157:0:15618:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787360173.750162:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360173.750166:0:15618:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360173.750170:0:15618:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff998a3505b370) has no exports 00000020:00000080:0.0:1787360173.759485:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a2ed5b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787360173.759505:0:8:0:(genops.c:885:class_export_put()) final put ffff998a2ecd4800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787360173.759510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787360173.759532:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787360173.759610:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ee3a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000100:00080000:0.0:1787360173.818305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360173.818315:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360173.818318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787360173.818321:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360173.818397:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360173.818415:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596106240:0@lo:400:kworker.0 00000400:00000100:0.0:1787360173.818592:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596106240 offset 0 length 224: 4 00000020:00000080:0.0:1787360173.845109:0:15618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360173.845124:0:15618:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787360173.845130:0:15618:0:(genops.c:885:class_export_put()) final put ffff998a10f4c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787360173.845134:0:15618:0:(genops.c:844:class_export_destroy()) destroying export ffff998a10f4c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787360173.845146:0:15618:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787360173.845415:0:15618:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff998a3d61f000 00000020:02000400:0.0:1787360173.845461:0:15618:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787360174.201836:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360175.231462:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360176.250143:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360176.764124:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360161/real 1787360161] req@ffff998a2eddd880 x1874182596105344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787360176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360176.764164:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2eddd880 x1874182596105344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787360176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360176.764189:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360176.764285:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360176.764292:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360176.764295:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787360176.764298:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787360176.764302:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360176.764307:0:14779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1787360176.764314:0:14779:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787360176.764323:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360176.764365:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903949f80 x1874182596106368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360176.766411:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596106496:0@lo:400:kworker.0 00000400:00000100:3.0:1787360176.766489:0:3659:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596106496 offset 0 length 224: 4 00000100:00080000:0.0:1787360176.771441:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360176.771455:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596105344:0@lo:38:kworker.0 00000100:00100000:0.0:1787360176.771617:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596106368:0@lo:38:kworker.0 00000400:00000100:0.0:1787360176.771687:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596106368 offset 0 length 520: 4 00010000:00010000:1.0:1787360177.274822:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787360177.785873:0:3659:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360161/real 1787360161] req@ffff998a2edde680 x1874182596105472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360177 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360177.833948:0:3659:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff998a2edde680 x1874182596105472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787360177 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360177.833981:0:3659:0:(import.c:65:import_set_state_nolock()) ffff998903736000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787360177.833986:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787360177.850904:0:3659:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787360177.850986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360177.850993:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360177.850997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360177.851000:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360177.851003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360177.851007:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787360177.851011:0:8:0:(import.c:65:import_set_state_nolock()) ffff998903736000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360177.851023:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 237 00000100:00080000:3.0:1787360177.851034:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff998903736000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360177.851100:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596105472:0@lo:400:kworker.0 00000100:00100000:3.0:1787360177.851609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998902914000 x1874182596106624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360177.851714:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596106624:0@lo:38:kworker.0 00000400:00000100:0.0:1787360177.851785:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182596106624 offset 0 length 520: 4 00000020:01000004:0.0:1787360177.938322:0:15820:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360177.958718:0:15820:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787360177.958861:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.958881:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.958890:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.958925:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.958958:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360177.958965:0:15820:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787360177.958994:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360177.959008:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998903949f80 x1874182596106368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360177.959034:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360177.959041:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360177.959049:0:15820:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787360177.959055:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360177.959059:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998903949f80 x1874182596106368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360196 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360177.959066:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360177.959069:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1787360177.959099:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596106368:0@lo:38:kworker.0 00000100:00080000:1.0:1787360177.962561:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787360177.962603:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998902916300 x1874182596105728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360180 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962652:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998903949180 x1874182596105856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962674:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddd180 x1874182596106112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360184 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962683:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddfb80 x1874182596106240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962696:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998903948700 x1874182596106496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360192 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962706:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998902914000 x1874182596106624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360177.962720:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1787360177.962752:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596105728:0@lo:400:kworker.0 00010000:00010000:2.0:1787360177.963485:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360177.963513:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360177.963526:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:2.0:1787360177.963531:0:6520:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360177.963543:0:6520:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360177.963552:0:6520:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360177.963559:0:6520:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360177.963561:0:6520:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787360177.963565:0:6520:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787360177.963589:0:6520:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:2.0:1787360177.963607:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360177.963626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35040800/0x359a4e2aee71ffa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffae expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360177.963653:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360177.963655:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360177.963661:0:6520:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360177.966680:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998903736000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360177.966696:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787360177.966703:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596106624:0@lo:38:kworker.0 00000100:00080000:3.0:1787360177.966990:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787360177.967054:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596106496:0@lo:400:kworker.0 00000100:00100000:0.0:1787360177.967072:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596106240:0@lo:400:kworker.0 00000100:00100000:1.0:1787360177.967133:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596106112:0@lo:400:kworker.0 00000100:00100000:1.0:1787360177.967146:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596105856:0@lo:400:kworker.0 00000100:00080000:3.0:1787360177.967199:0:15820:0:(import.c:65:import_set_state_nolock()) ffff998903736000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787360177.967208:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787360177.967212:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787360177.967218:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787360177.970073:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970098:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970127:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970133:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970203:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360177.970213:0:15820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970221:0:15820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970259:0:15820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360177.970265:0:15820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970556:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360177.970565:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970573:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360177.970577:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970586:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360177.970592:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360177.970606:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360177.970608:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787360177.970622:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:1.0:1787360177.970626:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970632:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06680800/0x359a4e2aee71ffb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71ffbc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970646:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360177.970649:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970655:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360177.970657:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970664:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360177.970670:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360177.970676:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787360177.970679:0:6519:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787360177.970692:0:6519:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:1.0:1787360177.970696:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360177.970719:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360177.970721:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360177.970723:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360177.971548:0:15820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787360177.971557:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a01689000/0x359a4e2aee720239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee720240 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360177.971577:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787360177.971583:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787360177.971585:0:15820:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787360177.971621:0:15820:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787360177.971626:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:1.0:1787360177.971749:0:7473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360177.971764:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360177.971772:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787360177.971777:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9989034d19b8) has no exports 00000020:00080000:1.0:1787360177.971963:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9989034d19b8) has no exports 00000020:01000000:1.0:1787360177.975055:0:15820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989029d8cc0 - data ffff998a29e83a20/ffff998a2ef6a400 00000020:01000000:1.0:1787360177.975474:0:15820:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9989037c4ae0 - data ffff99890208b000/ffff998903a01400 00100000:10000000:3.0:1787360177.993815:0:15820:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787360178.000190:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe49 00000020:00000080:2.0:1787360178.000206:0:15820:0:(genops.c:885:class_export_put()) final put ffff998a2ed99000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787360178.000256:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998902639800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787360178.000261:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998902639800 2 00000020:01000004:2.0:1787360178.000265:0:15820:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff998902639800 from lustre-OST0001 00000020:00000080:2.0:1787360178.000302:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360178.000314:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787360178.000318:0:15820:0:(genops.c:885:class_export_put()) final put ffff998a2ecd3000/lustre-OST0001_UUID 00000020:00000080:2.0:1787360178.000321:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ecd3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787360178.000328:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787360178.000472:0:15820:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a3f976a1-9d05-40f0-9d87-e3c95a944c03->MGS 00010000:00010000:2.0:1787360178.000491:0:15820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a06681600/0x359a4e2aee71fba2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360178.000531:0:15820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a06681600/0x359a4e2aee71fba2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360178.000537:0:15820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787360178.000550:0:15820:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787360178.000553:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787360178.000572:0:15820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:2.0:1787360178.000576:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a06681600/0x359a4e2aee71fba2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee71fba9 expref: -99 pid: 7461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360178.000593:0:15820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360178.000600:0:15820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360178.000606:0:15820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360178.000608:0:15820:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787360178.000610:0:15820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787360178.000627:0:15820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff998a28e28800 00010000:00010000:2.0:1787360178.000631:0:15820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a35040e00/0x359a4e2aee720017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x359a4e2aee72001e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787360178.000720:0:15820:0:(import.c:65:import_set_state_nolock()) ffff998a28e28800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787360178.000729:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787360178.000732:0:15820:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787360178.000734:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787360178.000738:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787360178.000752:0:15820:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff998a2eddf800 x1874182596105984/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787360183 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787360178.000773:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360178.000776:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1787360178.000870:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ed99000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787360178.000967:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a3f976a1-9d05-40f0-9d87-e3c95a944c03:3657:1874182596105984:0@lo:250:kworker.0 10000000:01000000:2.0:1787360178.001144:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787360178.001153:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fa9f 00000020:00000080:2.0:1787360178.001161:0:15820:0:(genops.c:885:class_export_put()) final put ffff998a0ffaf800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 00000020:01000000:2.0:1787360178.001180:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.111@tcp (flags='') 00000020:00000080:2.0:1787360178.001191:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360178.001197:0:15820:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787360178.001202:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff998a3bac8000) has no exports 10000000:01000000:0.0:1787360178.001310:0:6528:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1787360178.001420:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a0ffaf800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 for MGC192.168.206.111@tcp 10000000:01000000:2.0:1787360178.001476:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.111@tcp: client import never connected 00000100:00080000:2.0:1787360178.001479:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787360178.001482:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360178.001485:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787360178.001487:0:15820:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787360178.001552:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360178.001558:0:15820:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.111@tcp (uuid a3f976a1-9d05-40f0-9d87-e3c95a944c03) 00000020:01000000:2.0:1787360178.001565:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787360178.001569:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360178.001572:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787360178.001578:0:15820:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff998903849000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360178.001583:0:15820:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff99890273cd28) has exports, disconnecting them 00000020:00080000:2.0:1787360178.001588:0:15820:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff998903849000), last request at 1787359959 00000020:00000080:2.0:1787360178.001593:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe73 00000020:00080000:2.0:1787360178.001606:0:15820:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998903849000): rc 0 00000020:00000080:2.0:1787360178.001610:0:15820:0:(genops.c:885:class_export_put()) final put ffff998903849000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787360178.001821:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998a28e28800 for MGC192.168.206.111@tcp 00000020:00000080:1.0:1787360178.001830:0:14779:0:(genops.c:885:class_export_put()) final put ffff998a28e2a800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 00000020:00000080:1.0:1787360178.001832:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998a28e2a800/a3f976a1-9d05-40f0-9d87-e3c95a944c03 for MGC192.168.206.111@tcp 00000020:01000000:1.0:1787360178.002220:0:14779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.111@tcp (a3f976a1-9d05-40f0-9d87-e3c95a944c03) 00000020:00000080:1.0:1787360178.002612:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998903849000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787360178.003591:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787360178.003598:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360178.003603:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360178.003609:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360178.003795:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360178.003805:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1787360178.003812:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787360178.003816:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360178.003821:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787360178.003829:0:15820:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff998903737000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787360178.003845:0:15820:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff998a3505cd28) has exports, disconnecting them 00000020:00080000:1.0:1787360178.003851:0:15820:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff998903737000), last request at 1787359959 00000020:00000080:1.0:1787360178.003855:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe88 00000020:00080000:1.0:1787360178.003872:0:15820:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff998903737000): rc 0 00000020:00000080:1.0:1787360178.003876:0:15820:0:(genops.c:885:class_export_put()) final put ffff998903737000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787360178.004291:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998902614000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787360178.004304:0:14779:0:(genops.c:885:class_export_put()) final put ffff998902a5c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787360178.004307:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998902a5c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787360178.004316:0:14779:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787360178.004406:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998903737000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787360178.016842:0:15820:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787360178.016853:0:15820:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787360178.016859:0:15820:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360178.016869:0:15820:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787360178.016978:0:14779:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff998903736000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787360178.017328:0:6520:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787360178.017550:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787360178.017623:0:7473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787360178.017937:0:6515:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff998a02a7b800:6515] 1 exiting: rc = 0 00000100:00100000:0.0:1787360178.018557:0:6514:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff998a02a7b200:6514] 0 exiting: rc = 1 00000100:00100000:1.0:1787360178.018607:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.021431:0:7474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff998a28edca00:7474] 3 exiting: rc = 0 00000100:00100000:0.0:1787360178.021572:0:6518:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff998a0ab46200:6518] 2 exiting: rc = 0 00000100:00100000:2.0:1787360178.021869:0:6517:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff998a0ab46600:6517] 1 exiting: rc = 0 00000100:00100000:1.0:1787360178.022274:0:6516:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff998a0ab47c00:6516] 0 exiting: rc = 1 00000100:00100000:0.0:1787360178.022445:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022454:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022461:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022469:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022476:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022483:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022491:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022508:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022516:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022526:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022532:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022537:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022543:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022548:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022555:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022566:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022573:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022579:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022587:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022594:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022602:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022608:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022614:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022619:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022625:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022630:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022636:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022642:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022658:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022665:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022671:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022677:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022683:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022689:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.022695:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025610:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025625:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025630:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025636:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025641:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025646:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025651:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025657:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025662:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025667:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025672:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025678:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025684:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025689:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025694:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025764:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025771:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025777:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025783:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025788:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025803:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025808:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025814:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025819:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025832:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025837:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025842:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025847:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360178.025884:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787360178.031162:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360178.031180:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787360178.031187:0:15820:0:(genops.c:885:class_export_put()) final put ffff998903733800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787360178.031193:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff998903733800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787360178.031201:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787360178.031316:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998902639800 1 00000020:00000080:0.0:1787360178.031324:0:15820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x359a4e2aee71fe18 00000020:00000080:0.0:1787360178.031772:0:15820:0:(genops.c:885:class_export_put()) final put ffff998902614800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787360178.031793:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787360178.031799:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360178.031806:0:15820:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360178.031811:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff998a3c900000) has no exports 00000020:00000080:2.0:1787360178.032737:0:14779:0:(genops.c:844:class_export_destroy()) destroying export ffff998902614800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787360178.090724:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360178.090740:0:15820:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787360178.090745:0:15820:0:(genops.c:885:class_export_put()) final put ffff99890263c800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787360178.090750:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff99890263c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787360178.090769:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787360178.091082:0:15820:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99890263b800 00000020:01000000:3.0:1787360178.091104:0:15820:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787360178.091108:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360178.091113:0:15820:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787360178.091117:0:15820:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff998a350599b8) has no exports 00000020:00000080:3.0:1787360178.091142:0:15820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360178.091147:0:15820:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787360178.091151:0:15820:0:(genops.c:885:class_export_put()) final put ffff998a2ee3f800/OSS_uuid 00000020:00000080:3.0:1787360178.091153:0:15820:0:(genops.c:844:class_export_destroy()) destroying export ffff998a2ee3f800/OSS_uuid for OSS 00000020:01000000:3.0:1787360178.091157:0:15820:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787360178.091252:0:8770:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9989028c3600:8770] 3 exiting: rc = 0 00000100:00100000:0.0:1787360178.091280:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff998a2ed17800:8448] 1 exiting: rc = 0 00000100:00080000:1.0:1787360178.091349:0:6527:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787360178.092324:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff998a3c837600:8450] 2 exiting: rc = 0 00000100:00100000:1.0:1787360178.098382:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff998a3b98d600:8447] 0 exiting: rc = 1 00000100:00100000:3.0:1787360178.098530:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098539:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098546:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098552:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098560:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098566:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098571:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098576:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098582:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098587:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098593:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098598:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098603:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098609:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098615:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098620:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098626:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098631:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098637:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098642:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098648:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098653:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098676:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098682:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098687:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098693:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098713:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098719:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098724:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098730:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098736:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098741:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098746:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098751:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098756:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098761:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098767:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098773:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098778:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098783:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098789:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098794:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098800:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098806:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098811:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098816:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098822:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098828:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098833:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098838:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098844:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098850:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098856:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098861:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098867:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098873:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098878:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098890:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098896:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098901:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098906:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098912:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098917:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.098930:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.099717:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff998a3ba4f200:8452] 1 exiting: rc = 0 00000100:00100000:0.0:1787360178.099721:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff998a3ba4f000:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1787360178.099815:0:13819:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff998904195600:13819] 2 exiting: rc = 0 00000100:00100000:3.0:1787360178.102019:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102029:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102036:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102040:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102046:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102050:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102055:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102060:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102066:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102071:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102076:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102081:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102086:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102091:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102096:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102101:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102107:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102112:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102118:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102123:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102127:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102132:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102137:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102153:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102158:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102163:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102167:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102189:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102194:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102198:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102205:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102208:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102213:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102217:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102221:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102255:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102261:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102266:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102271:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102275:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102280:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102284:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102289:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102294:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102298:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102303:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102308:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102314:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102319:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102324:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102330:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102335:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102339:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102344:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102349:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102354:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102359:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102365:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102371:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102378:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102385:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102389:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102404:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.102409:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.111592:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff998a2ecff000:8453] 0 exiting: rc = 1 00000100:00100000:0.0:1787360178.113404:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff998a2ecff600:8455] 2 exiting: rc = 0 00000100:00100000:0.0:1787360178.121413:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff998a2ecff800:8454] 1 exiting: rc = 0 00000100:00100000:2.0:1787360178.121586:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121593:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121598:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121603:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121609:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121614:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121619:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121625:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121631:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121636:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121641:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121646:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121652:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121658:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121665:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121683:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121690:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121696:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121702:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121730:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121738:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121744:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121749:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121754:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121760:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121767:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121774:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121779:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121786:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121792:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121798:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121818:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121824:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121830:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121835:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121841:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121847:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121853:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121859:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121864:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121870:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121875:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121881:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121904:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121912:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121917:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121923:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121929:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121935:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121940:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121945:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121951:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121957:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121962:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121968:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121974:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121979:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121985:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121991:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.121997:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.122003:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.122009:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.122027:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.122034:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.126632:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff998a2ecffe00:8456] 0 exiting: rc = 1 00000100:00100000:2.0:1787360178.135021:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff998a2ecffa00:8457] 1 exiting: rc = 0 00000100:00100000:3.0:1787360178.135852:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135861:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135866:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135871:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135877:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135882:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135887:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135892:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135898:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135904:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135909:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135914:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135920:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135925:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135937:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135944:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135950:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135955:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135961:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135966:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135971:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135976:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135981:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135987:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135992:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.135997:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136002:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136007:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136013:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136018:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136023:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136029:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136057:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136062:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136068:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136073:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136078:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136084:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136089:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136094:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136099:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136104:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136108:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136113:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136118:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136122:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136127:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136132:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136136:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136152:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136158:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136163:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136169:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136174:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136179:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136183:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136187:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136192:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136197:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136202:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136207:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136212:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136217:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.136223:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360178.137529:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff998a3cb30000:8458] 0 exiting: rc = 1 00000100:00100000:0.0:1787360178.137682:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff998a3cb31c00:8459] 1 exiting: rc = 0 00000100:00100000:3.0:1787360178.138079:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138088:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138094:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138111:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138118:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138123:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138129:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138135:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138151:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138295:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138302:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138307:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138327:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138334:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138340:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138351:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138356:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138362:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138368:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138374:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138380:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138386:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138391:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138397:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138415:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138423:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138428:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138433:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138439:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138444:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138450:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138456:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138462:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138468:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138477:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138484:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138516:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138524:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138537:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138542:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138553:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138559:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138563:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138569:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138574:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138579:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138584:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138590:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138607:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138614:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138619:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138625:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138630:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138635:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138641:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138646:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138651:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138656:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138662:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138667:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138687:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138694:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138705:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360178.138711:0:15820:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787360178.156413:0:15820:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787360198.501674:0:16584:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787360209.191636:0:17184:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787360209.191642:0:17184:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787360209.191643:0:17184:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787360209.191753:0:17184:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a3d61f800 00000020:01000004:3.0:1787360209.191767:0:17184:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787360209.191774:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787360209.191786:0:17184:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9989034d3370) 00000020:00000080:3.0:1787360209.191797:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787360209.266092:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.270476:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787360209.273493:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.273712:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.273905:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.274734:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.275019:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.275610:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.276197:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.277943:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.278201:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.278489:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.278723:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.278932:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787360209.280957:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.282189:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.289187:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.290022:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.290382:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.290586:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.290775:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.291060:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.291287:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.292189:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.293166:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.293445:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.293655:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.296098:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.296904:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.297135:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.300462:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.300877:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.301138:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787360209.301409:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.301660:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.301918:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787360209.302175:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.302557:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.302809:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.303061:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.303306:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.306808:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.308196:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.308641:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.308898:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.309163:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787360209.310257:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787360209.316820:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.317507:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.317754:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.318343:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.318587:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787360209.318974:0:17184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1787360209.319483:0:17184:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787360209.319680:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787360209.319687:0:17184:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787360209.319698:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee72105c 00000020:01000004:3.0:1787360209.319704:0:17184:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787360209.319709:0:17184:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787360209.319714:0:17184:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a3d61f800 from MGS 00000020:01000004:3.0:1787360209.319718:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787360209.319727:0:17184:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9989034d19b8) 00000020:00000080:3.0:1787360209.319737:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787360209.320127:0:17184:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61f800 from MGS, refs=2 00080000:01000000:3.0:1787360209.320133:0:17184:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787360209.320138:0:17184:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee72106a 00000100:00100000:3.0:1787360209.320269:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787360209.320413:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787360209.320418:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787360209.331083:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787360209.331102:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787360209.340294:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360209.340479:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787360209.340485:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787360209.342758:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787360209.343424:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787360209.343876:0:17184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787360209.343883:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787360209.344809:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.344813:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.344815:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.345130:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.345133:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.345134:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360209.346886:0:17184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787360209.348736:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787360209.354172:0:17184:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787360209.359952:0:17196:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787360209.360018:0:17184:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787360209.360070:0:17184:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787360209.360777:0:17184:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787360209.361056:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360209.361200:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787360209.361206:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787360209.361753:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787360209.361760:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787360209.362117:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787360209.362123:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787360209.362809:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787360209.362831:0:17184:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.111@tcp' 00000020:01000004:1.0:1787360209.362833:0:17184:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787360209.362860:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.111@tcp (typ=mgc) 00000020:00000080:1.0:1787360209.362872:0:17184:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.111@tcp (ffff998a35058000) 00000020:00000080:1.0:1787360209.362885:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787360209.362962:0:17184:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3ff48800@MGC192.168.206.111@tcp: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787360209.363163:0:17184:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.111@tcp-0 is initialized 00000040:01000000:1.0:1787360209.363170:0:17184:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787360209.363292:0:17200:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787360209.379902:0:17202:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787360209.380022:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.111@tcp (uuid 9b5a46b1-7024-40db-b9fb-69c8c09a9227) 00000020:00000080:2.0:1787360209.380047:0:17184:0:(genops.c:1385:class_connect()) connect: client 9b5a46b1-7024-40db-b9fb-69c8c09a9227, cookie 0x359a4e2aee721078 00000100:00080000:2.0:1787360209.380059:0:17184:0:(import.c:510:import_select_connection()) MGC192.168.206.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360209.380066:0:17184:0:(import.c:624:import_select_connection()) MGC192.168.206.111@tcp: import ffff998a3ff48800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360209.380097:0:17184:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903949880 x1874182596106752/t0(0) o250->MGC192.168.206.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360209.380126:0:17184:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9b5a46b1-7024-40db-b9fb-69c8c09a9227->MGS 00000020:01000004:2.0:1787360209.380143:0:17184:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787360209.380148:0:17184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787360209.380161:0:17184:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99890273cd28) 00000020:00000080:2.0:1787360209.380172:0:17184:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787360209.380823:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596106752:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787360209.380888:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.382439:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596106752 00000100:00100000:2.0:1787360209.382449:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596106752 00000100:00100000:2.0:1787360209.382484:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360209.382493:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3657:x1874182596106752:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787360209.382518:0:17197:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9b5a46b1-7024-40db-b9fb-69c8c09a9227@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:2.0:1787360209.382545:0:17197:0:(genops.c:1385:class_connect()) connect: client 9b5a46b1-7024-40db-b9fb-69c8c09a9227, cookie 0x359a4e2aee721086 00000100:00080000:2.0:1787360209.382692:0:17197:0:(import.c:65:import_set_state_nolock()) ffff9989041a8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360209.382763:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+5:3657:x1874182596106752:12345-0@lo:250:mount.lustre.0 Request processed in 268us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.382773:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360209.385117:0:3657:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787360209.385134:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1787360209.385151:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787360209.385156:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787360209.385161:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3ff48800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787360209.385164:0:3657:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787360209.385187:0:3657:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787360209.385196:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3657:1874182596106752:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787360209.390667:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360209.390941:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787360209.390949:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787360209.392068:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787360209.392078:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787360209.398316:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787360209.398404:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787360209.412693:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360209.412930:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787360209.412936:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787360209.414679:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787360209.414690:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787360209.463847:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360209.466296:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787360209.466307:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787360209.468967:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787360209.468990:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787360209.470169:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360209.470550:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787360209.470557:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787360209.478206:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787360209.478395:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787360209.488169:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360209.488450:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787360209.488457:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787360209.489497:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787360209.489506:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787360209.490756:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360209.490912:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787360209.490923:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787360209.491566:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787360209.491573:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787360209.533319:0:17184:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360209.533599:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787360209.533606:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787360209.535377:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787360209.535389:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787360209.539836:0:17184:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787360209.539849:0:17184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787360209.540960:0:17184:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787360209.541047:0:17184:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787360209.541053:0:17184:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787360209.541143:0:17184:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787360209.541175:0:17184:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787360209.541179:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787360209.541181:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.541182:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.541183:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.541184:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.541185:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.541187:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.541188:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.541190:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.541191:0:17184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787360209.541194:0:17184:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787360209.541196:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787360209.541197:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.541198:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.541199:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.541201:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.541202:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.541207:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.541208:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.541209:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.541210:0:17184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787360209.541298:0:17184:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787360209.541315:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596106880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787360209.541385:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.541474:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7900 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.541560:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596106880 00000100:00100000:2.0:1787360209.541567:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596106880 00000100:00100000:2.0:1787360209.541634:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360209.541643:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+5:17184:x1874182596106880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360209.541685:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787360209.541691:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787360209.541694:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787360209.542596:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787360209.543128:0:17199:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1787360209.544908:0:17222:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787360209.544914:0:17222:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787360209.544916:0:17222:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787360209.544919:0:17222:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787360209.545117:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787360209.545387:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787360209.545396:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787360209.570437:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+5:17184:x1874182596106880:12345-0@lo:253:mount.lustre.0 Request processed in 28785us (29042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360209.570458:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360209.570565:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596106880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360209.570579:0:17184:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787360209.570582:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360209.570584:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.570585:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.570587:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.570588:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.570589:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.570590:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.570593:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.570595:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.570596:0:17184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787360209.570614:0:17184:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a3d61f800 from lustre-MDT0000 10000000:01000000:0.0:1787360209.570640:0:17184:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787360209.570643:0:17184:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787360209.570647:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff998a35058000 10000000:01000000:0.0:1787360209.570651:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360209.570658:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff998a35058000 from 1 10000000:01000000:0.0:1787360209.570661:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787360209.570695:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.570706:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.570715:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.570744:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360209.570778:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.570816:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.570879:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107008 00000100:00100000:2.0:1787360209.570885:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107008 00000100:00100000:2.0:1787360209.570931:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360209.570940:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+5:17184:x1874182596107008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.570952:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360209.570964:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696a00/0x359a4e2aee721094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72108d expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.570997:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696a00/0x359a4e2aee721094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72108d expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.571007:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696a00/0x359a4e2aee721094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72108d expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.571015:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696a00, rc 0) 00000100:00100000:2.0:1787360209.572107:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+6:17184:x1874182596107008:12345-0@lo:101:mount.lustre.0 Request processed in 1164us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.572116:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360209.573486:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360209.573514:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.573528:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.573636:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360209.573690:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.573732:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360209.573831:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107136 00000100:00100000:3.0:1787360209.573838:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107136 00000100:00100000:3.0:1787360209.573892:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360209.573900:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+6:17184:x1874182596107136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360209.573999:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+6:17184:x1874182596107136:12345-0@lo:501:mount.lustre.0 Request processed in 100us (308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360209.574008:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360209.574139:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107136:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360209.574172:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787360209.574193:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574202:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360209.574220:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a3d61f800 10000000:01000000:2.0:1787360209.574247:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360209.574252:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff998a3d61f800 10000000:01000000:2.0:1787360209.574255:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787360209.574259:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff998a3d61f800 from 1 10000000:01000000:2.0:1787360209.574261:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787360209.574286:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574294:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574303:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360209.574317:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360209.574355:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.574380:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107264 00000100:00100000:2.0:1787360209.574384:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107264 00000100:00100000:2.0:1787360209.574409:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360209.574415:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+6:17184:x1874182596107264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.574423:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360209.574435:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697c00/0x359a4e2aee7210a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72109b expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574450:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697c00/0x359a4e2aee7210a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72109b expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574472:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697c00/0x359a4e2aee7210a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72109b expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574480:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697c00, rc 0) 00000100:00100000:2.0:1787360209.574506:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+7:17184:x1874182596107264:12345-0@lo:101:mount.lustre.0 Request processed in 91us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.574512:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360209.574538:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.574550:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.574560:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574567:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360209.574579:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787360209.574583:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574589:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696600/0x359a4e2aee72109b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210a2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360209.574594:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787360209.574598:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360209.574601:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff998a3d61f800 10000000:01000000:2.0:1787360209.574604:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787360209.574606:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787360209.574614:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787360209.574628:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574634:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574641:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360209.574652:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360209.574676:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.574695:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107392 00000100:00100000:2.0:1787360209.574698:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107392 00000100:00100000:2.0:1787360209.574719:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360209.574725:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+7:17184:x1874182596107392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.574731:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360209.574738:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697000/0x359a4e2aee7210b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7210a9 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574751:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697000/0x359a4e2aee7210b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7210a9 expref: 8 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574758:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697000/0x359a4e2aee7210b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7210a9 expref: 8 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574764:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697000, rc 0) 00000100:00100000:2.0:1787360209.574788:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+8:17184:x1874182596107392:12345-0@lo:101:mount.lustre.0 Request processed in 63us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.574793:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360209.574827:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.574838:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.574848:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.574854:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360209.574895:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360209.574918:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.574937:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107520 00000100:00100000:2.0:1787360209.574941:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107520 00000100:00100000:2.0:1787360209.574961:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360209.574967:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+8:17184:x1874182596107520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360209.575215:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17184:x1874182596107520:12345-0@lo:501:mount.lustre.0 Request processed in 247us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.575223:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360209.575278:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.575290:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360209.575316:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360209.575364:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.575384:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107648 00000100:00100000:2.0:1787360209.575388:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107648 00000100:00100000:2.0:1787360209.575410:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360209.575417:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17184:x1874182596107648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360209.577123:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.577732:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17184:x1874182596107648:12345-0@lo:503:mount.lustre.0 Request processed in 2311us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.577748:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360209.587135:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596107648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360209.587625:0:17223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17223:1874182596107776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.587689:0:17223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.587729:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360209.587775:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107776 00000100:00100000:1.0:1787360209.587781:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107776 00000100:00100000:1.0:1787360209.587825:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360209.587833:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17223:x1874182596107776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.588530:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17223:x1874182596107776:12345-0@lo:502:llog_process_th.0 Request processed in 695us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.588543:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360209.588622:0:17223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17223:1874182596107776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787360209.588646:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360209.588656:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.588658:0:17223:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787360209.588662:0:17223:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787360209.588665:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360209.588677:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff998902738000) 00000020:00000080:2.0:1787360209.588691:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787360209.588696:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787360209.588772:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787360209.588780:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7210be 00000020:00000080:2.0:1787360209.588957:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787360209.588961:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360209.588965:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.588966:0:17223:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787360209.588969:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360209.588972:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.588973:0:17223:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787360209.588988:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360209.588995:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99890273b370) 00000020:00000080:2.0:1787360209.589004:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787360209.589008:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787360209.589010:0:17223:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787360209.589012:0:17223:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787360209.589017:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787360209.589051:0:17223:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61f800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787360209.589061:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9989027399b8) 00000020:00000080:2.0:1787360209.589067:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787360209.589114:0:17223:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787360209.589118:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7210d3 00000020:00000080:2.0:1787360209.589199:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787360209.589204:0:17223:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787360209.589208:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x359a4e2aee7210da 00080000:01000000:2.0:1787360209.589212:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787360209.589215:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7210e1 00010000:00010000:3.0:1787360209.697147:0:17223:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787360209.697678:0:17223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1787360209.698027:0:17223:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787360209.698559:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9989034d4d28) 00000020:00000080:3.0:1787360209.698576:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787360209.698640:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787360209.698647:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee7210ef 00000020:00000080:0.0:1787360209.699373:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787360209.701719:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x359a4e2aee7210f6 00000020:00000080:0.0:1787360209.702195:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787360209.702205:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360209.702211:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.702213:0:17223:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787360209.702216:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360209.702255:0:17223:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787360209.702258:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360209.702260:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360209.702262:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360209.702265:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.702267:0:17223:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360209.702270:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.702274:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.702276:0:17223:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787360209.702280:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787360209.702315:0:17223:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787360209.702329:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360209.702343:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.702344:0:17223:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787360209.702347:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.702351:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.702352:0:17223:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787360209.702355:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360209.702360:0:17223:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:0.0:1787360209.702381:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360209.702393:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff998a3c904d28) 00000020:00000080:0.0:1787360209.702404:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787360209.702408:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360209.702464:0:17223:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787360209.702469:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787360209.702474:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee721104 00010000:00080000:0.0:1787360209.702503:0:17223:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a19704000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360209.707810:0:17223:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787360209.719135:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360209.719148:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787360209.719191:0:17223:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787360209.719214:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee72110b 00000100:00080000:2.0:1787360209.719251:0:17223:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360209.719257:0:17223:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360209.719291:0:17223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903948e00 x1874182596107904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360209.719315:0:17223:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787360209.719382:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360209.719386:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.719388:0:17223:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787360209.719391:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787360209.719393:0:17223:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787360209.719395:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360209.719396:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360209.719398:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787360209.719400:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.719401:0:17223:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787360209.719404:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787360209.719408:0:17223:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787360209.719411:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360209.719412:0:17223:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787360209.719415:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787360209.719419:0:17223:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:2.0:1787360209.719442:0:17223:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787360209.719444:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360209.719475:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff998a359499b8) 00000020:00000080:2.0:1787360209.719489:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787360209.719495:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787360209.719558:0:17223:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787360209.719564:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787360209.719570:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee721119 00010000:00080000:2.0:1787360209.719596:0:17223:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9989036e0000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787360209.719796:0:17223:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787360209.720498:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596107904:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360209.720562:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360209.720739:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596107904 00000100:00100000:2.0:1787360209.720746:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596107904 00000100:00100000:2.0:1787360209.720773:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360209.720780:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596107904:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787360209.720796:0:17210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1787360209.730081:0:17223:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360209.730470:0:17223:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787360209.733508:0:17223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360209.734043:0:17223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787360209.734184:0:17223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787360209.736929:0:17229:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787360209.736938:0:17229:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787360209.737971:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360209.737984:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787360209.738020:0:17223:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787360209.738040:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721120 00000100:00080000:1.0:1787360209.738050:0:17223:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360209.738056:0:17223:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9989036e0000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360209.738089:0:17223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904158a80 x1874182596108032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360209.738114:0:17223:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787360209.738160:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360209.738164:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.738166:0:17223:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787360209.738169:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787360209.738172:0:17223:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787360209.738174:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787360209.738175:0:17223:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787360209.738177:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787360209.738179:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.738181:0:17223:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787360209.738183:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787360209.738186:0:17223:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787360209.738190:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.738191:0:17223:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787360209.738194:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787360209.738198:0:17223:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:1.0:1787360209.738254:0:17223:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787360209.738258:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360209.738268:0:17223:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff998a350599b8) 00000020:00000080:1.0:1787360209.738280:0:17223:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787360209.738285:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787360209.738351:0:17223:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787360209.738356:0:17223:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787360209.738362:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x359a4e2aee72112e 00010000:00080000:1.0:1787360209.738389:0:17223:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c9c5000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787360209.738588:0:17223:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787360209.738669:0:17223:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787360209.738682:0:17223:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787360209.739178:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596108032:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787360209.739251:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596108032 offset 0 length 520: 4 00000100:00100000:2.0:1787360209.742443:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596107904:12345-0@lo:38:llog_process_th.0 Request processed in 21654us (21873us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360209.742515:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787360209.742573:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360209.742577:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360209.742581:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596107904:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787360209.745748:0:17223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360209.746074:0:17223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787360209.746652:0:17223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787360209.747168:0:17231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787360209.747173:0:17231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787360209.747904:0:17223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360209.747917:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787360209.747953:0:17223:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787360209.747973:0:17223:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee721135 00000100:00080000:1.0:1787360209.748052:0:17223:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360209.748057:0:17223:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a3c9c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360209.748092:0:17223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904158e00 x1874182596108160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360209.748119:0:17223:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787360209.748156:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596108160:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787360209.748216:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596108160 offset 0 length 520: 4 00000020:01000000:1.0:1787360209.748264:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360209.748268:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.748270:0:17223:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787360209.748273:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360209.748277:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.748278:0:17223:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787360209.748288:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787360209.748290:0:17223:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787360209.748293:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360209.748295:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.748296:0:17223:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787360209.748298:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360209.748300:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.748301:0:17223:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787360209.748304:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787360209.748344:0:17223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17223:1874182596108288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360209.748393:0:17223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.748415:0:17223:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.748678:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108288 00000100:00100000:2.0:1787360209.748684:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108288 00000100:00100000:2.0:1787360209.748731:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360209.748741:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17223:x1874182596108288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360209.748863:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17223:x1874182596108288:12345-0@lo:502:llog_process_th.0 Request processed in 123us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.748872:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360209.748927:0:17223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17223:1874182596108288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787360209.748952:0:17223:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360209.748956:0:17223:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360209.748957:0:17223:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787360209.748960:0:17223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787360209.749114:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787360209.749135:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787360209.749158:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.749168:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696800/0x359a4e2aee7210a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7210b0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360209.749174:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a3d61f800 from 1 10000000:01000000:0.0:1787360209.749177:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360209.749201:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.749209:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.749218:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.749261:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360209.749290:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.749311:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360209.749478:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108416 00000100:00100000:1.0:1787360209.749483:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108416 00000100:00100000:1.0:1787360209.749514:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360209.749521:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+9:17184:x1874182596108416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360209.749530:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360209.749543:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72113c expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.749561:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72113c expref: 10 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.749570:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72113c expref: 10 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.749591:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71000, rc 0) 00000100:00100000:1.0:1787360209.749619:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+10:17184:x1874182596108416:12345-0@lo:101:mount.lustre.0 Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360209.749626:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360209.749748:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360209.749760:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.749774:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.750644:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108544:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787360209.750692:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.750717:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360209.750804:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108544 00000100:00100000:3.0:1787360209.750809:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108544 00000100:00100000:3.0:1787360209.750845:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360209.750853:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+10:17184:x1874182596108544:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787360209.750869:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787360209.750876:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787360209.750946:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+10:17184:x1874182596108544:12345-0@lo:256:mount.lustre.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360209.750959:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360209.751141:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108544:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787360209.752038:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360209.752110:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.752121:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360209.752130:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61f800 from 1 10000000:01000000:0.0:1787360209.752133:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360209.752163:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.752172:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.752181:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.752198:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360209.752271:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.752310:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.752428:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108672 00000100:00100000:2.0:1787360209.752434:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108672 00000100:00100000:2.0:1787360209.752479:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360209.752488:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+10:17184:x1874182596108672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.752498:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360209.752510:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72114a expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.752529:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72114a expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.752539:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72114a expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.752547:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697e00, rc 0) 00000100:00100000:2.0:1787360209.752589:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596108672:12345-0@lo:101:mount.lustre.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.752596:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360209.752700:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360209.752714:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.752722:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360209.752777:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360209.752804:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.752832:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204f8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787360209.752878:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108800 00000100:00100000:0.0:1787360209.752882:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108800 00000100:00100000:0.0:1787360209.752909:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787360209.752916:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596108800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360209.753040:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596108800:12345-0@lo:501:mount.lustre.0 Request processed in 124us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.753047:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360209.753169:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360209.753197:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360209.753298:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.753314:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204f8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787360209.753369:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596108928 00000100:00100000:0.0:1787360209.753373:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596108928 00000100:00100000:0.0:1787360209.753409:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787360209.753416:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596108928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360209.753498:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596108928:12345-0@lo:503:mount.lustre.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.753505:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360209.753584:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596108928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360209.754000:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17233:1874182596109056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360209.754036:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.754058:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a204f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.754119:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109056 00000100:00100000:2.0:1787360209.754124:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109056 00000100:00100000:2.0:1787360209.754156:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360209.754163:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17233:x1874182596109056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360209.755321:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17233:x1874182596109056:12345-0@lo:502:llog_process_th.0 Request processed in 1153us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.755357:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360209.755550:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17233:1874182596109056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787360209.755659:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.755669:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.755671:0:17233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787360209.755679:0:17233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3d61f800 00000020:00000080:0.0:1787360209.755682:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360209.755689:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360209.755691:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.755693:0:17233:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787360209.755696:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.755698:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.755699:0:17233:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787360209.755703:0:17233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a3d61f800 00000020:00000080:0.0:1787360209.755705:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360209.755797:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360209.755801:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.755807:0:17233:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787360209.755811:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.755813:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.755815:0:17233:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360209.755818:0:17233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3d61f800 00000020:00000080:0.0:1787360209.755820:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787360209.757343:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360209.757352:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.757354:0:17233:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787360209.757358:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360209.757362:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360209.757363:0:17233:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787360209.757369:0:17233:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a3d61f800 00000020:00000080:0.0:1787360209.757371:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787360209.757436:0:17233:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17233:1874182596109184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.757509:0:17233:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.757552:0:17233:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.757635:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109184 00000100:00100000:2.0:1787360209.757642:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109184 00000100:00100000:2.0:1787360209.757692:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787360209.757701:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17233:x1874182596109184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360209.757867:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17233:x1874182596109184:12345-0@lo:502:llog_process_th.0 Request processed in 166us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.757874:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360209.759722:0:17233:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17233:1874182596109184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360209.759762:0:17233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360209.759781:0:17233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360209.759783:0:17233:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787360209.759788:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787360209.760130:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787360209.760153:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360209.760176:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.760187:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360209.760259:0:17184:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360209.760262:0:17184:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a3d61f800 10000000:01000000:0.0:1787360209.760265:0:17184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a3d61f800 10000000:01000000:0.0:1787360209.760269:0:17184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360209.760274:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a3d61f800 from 1 10000000:01000000:0.0:1787360209.760277:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360209.760309:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.760317:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.760326:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.760356:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360209.760408:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.760438:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.761546:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109312 00000100:00100000:2.0:1787360209.761554:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109312 00000100:00100000:2.0:1787360209.761606:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787360209.761616:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17184:x1874182596109312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360209.761629:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360209.761642:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697200/0x359a4e2aee72115f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721158 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.761664:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697200/0x359a4e2aee72115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721158 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.761673:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697200/0x359a4e2aee72115f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721158 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360209.761681:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697200, rc 0) 00000100:00100000:2.0:1787360209.761736:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596109312:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360209.761742:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360209.762167:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360209.762184:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.762193:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360209.762272:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360209.762302:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.762343:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360209.762419:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109440 00000100:00100000:3.0:1787360209.762424:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109440 00000100:00100000:3.0:1787360209.762456:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787360209.762463:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596109440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360209.762569:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596109440:12345-0@lo:501:mount.lustre.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360209.762577:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360209.762647:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360209.762671:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360209.762707:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.762726:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360209.762732:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109568 00000100:00100000:1.0:1787360209.762736:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109568 00000100:00100000:1.0:1787360209.762768:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360209.762775:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596109568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360209.762858:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596109568:12345-0@lo:503:mount.lustre.0 Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360209.762867:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360209.763315:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596109568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360209.764859:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596109696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360209.764914:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360209.765003:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360209.772656:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109696 00000100:00100000:0.0:1787360209.772672:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109696 00000100:00100000:0.0:1787360209.772724:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360209.772734:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596109696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.772902:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596109696:12345-0@lo:502:llog_process_th.0 Request processed in 168us (7987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.772910:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360209.773042:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596109696:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787360209.773110:0:17236:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787360209.773124:0:17236:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff998a3c900000) 00000020:00000080:0.0:1787360209.773141:0:17236:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787360209.773253:0:17236:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a3d61f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787360209.773258:0:17236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a3d61f800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787360209.773260:0:17236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a3d61f800 4 00010000:00080000:0.0:1787360209.773295:0:17236:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3c824000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360209.777716:0:17236:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787360209.778695:0:17236:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787360209.778735:0:17236:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360209.778748:0:17236:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x359a4e2aee72116d 00000100:00080000:0.0:1787360209.778757:0:17236:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360209.778763:0:17236:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff998a3c824000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360209.779580:0:17236:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edded80 x1874182596109824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360209.779603:0:17236:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787360209.779622:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596109824:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787360209.779630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360209.779635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787360209.779642:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360209.779646:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1787360209.779650:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360209.779654:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360209.779667:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddd500 x1874182596109952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360209.779677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360209.779680:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360209.779683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1787360209.779686:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360209.779686:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360209.781770:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596109952:0@lo:38:kworker.0 00000100:00100000:1.0:1787360209.781833:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.781893:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109824 00000100:00100000:1.0:1787360209.781902:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109824 00000100:00100000:1.0:1787360209.781941:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360209.781948:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596109824:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360209.781953:0:17206:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787360209.781960:0:17206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787360209.782002:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596109824:12345-0@lo:38:llog_process_th.0 Request processed in 52us (2315us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787360209.782009:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360209.782057:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787360209.782065:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c824000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360209.782069:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787360209.782072:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596109824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787360209.784655:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596109952 00000100:00100000:3.0:1787360209.784666:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596109952 00000100:00100000:3.0:1787360209.784706:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360209.784713:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596109952:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787360209.784731:0:17211:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787360209.784810:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596109952:12345-0@lo:38:kworker.0 Request processed in 95us (2976us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787360209.784817:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787360209.784867:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360209.784877:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360209.784881:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596109952:0@lo:38:kworker.0 00000100:00100000:0.0:1787360209.785829:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596110080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.785884:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.785914:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32840 going to sleep for 11 seconds 00000100:00100000:0.0:1787360209.786079:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110080 00000100:00100000:0.0:1787360209.786085:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110080 00000100:00100000:0.0:1787360209.786121:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360209.786137:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596110080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.786262:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596110080:12345-0@lo:502:llog_process_th.0 Request processed in 133us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.786270:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360209.786314:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596110080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.786563:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596110208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360209.786602:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.786625:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3cad7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360209.786862:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110208 00000100:00100000:1.0:1787360209.786867:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110208 00000100:00100000:1.0:1787360209.786903:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787360209.786911:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596110208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360209.787000:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17236:x1874182596110208:12345-0@lo:502:llog_process_th.0 Request processed in 89us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360209.787007:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787360209.787063:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17236:1874182596110208:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787360209.787088:0:17236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787360209.787168:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787360209.787190:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787360209.787211:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.787221:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caeec00/0x359a4e2aee721158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72115f expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787360209.787292:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787360209.787294:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.787295:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.787296:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.787297:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.787299:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.787300:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.787302:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.787303:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.787305:0:17184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787360209.787308:0:17184:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787360209.787311:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787360209.787312:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.787313:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.787313:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.787314:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.787315:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.787316:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.787317:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.787318:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.787319:0:17184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787360209.787346:0:17184:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787360209.787360:0:17184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596110336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787360209.787388:0:17184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360209.787411:0:17184:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a11b32540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360209.787549:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110336 00000100:00100000:2.0:1787360209.787560:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110336 00000100:00100000:2.0:1787360209.787595:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360209.787602:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596110336:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360209.787622:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787360209.787632:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787360209.791385:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787360209.791437:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787360209.791746:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17184:x1874182596110336:12345-0@lo:253:mount.lustre.0 Request processed in 4139us (4351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360209.791758:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787360209.791833:0:17184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17184:1874182596110336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360209.791845:0:17184:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787360209.791848:0:17184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360209.791850:0:17184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360209.791851:0:17184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360209.791852:0:17184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360209.791854:0:17184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360209.791855:0:17184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360209.791856:0:17184:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360209.791858:0:17184:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360209.791860:0:17184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360209.791861:0:17184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360209.791873:0:17184:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787360209.795043:0:17221:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787360209.795052:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787360209.795073:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.795102:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72113c expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.795110:0:17221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.795150:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 11 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.795166:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 11 pid: 17197 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360209.795180:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596110464:0@lo:104: 00000100:00100000:1.0:1787360209.795254:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.795356:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3ba286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360209.801950:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110464 00000100:00100000:3.0:1787360209.801960:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110464 00000100:00100000:3.0:1787360209.802219:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360209.802249:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596110464:12345-0@lo:104: 00010000:00010000:3.0:1787360209.802266:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360209.802377:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360209.802383:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596110464:12345-0@lo:104: Request processed in 138us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360209.802390:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787360209.802480:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360209.802487:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.802495:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360209.802499:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.802508:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360209.802526:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360209.802531:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360209.802564:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.802571:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360209.802590:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.802597:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee72113c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721143 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.802612:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.802614:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360209.802615:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360209.802643:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596110592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360209.802682:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360209.802863:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596110464:0@lo:104: 00010000:00010000:1.0:1787360209.802886:0:17221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360209.802916:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110592 00000100:00100000:1.0:1787360209.802919:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110592 00010000:00010000:1.0:1787360209.802945:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 12 pid: 17197 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360209.804523:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360209.804535:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:3660:x1874182596110592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360209.804548:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360209.804555:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 12 pid: 17197 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804567:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 12 pid: 17197 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804581:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71000/0x359a4e2aee721143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72113c expref: 12 pid: 17197 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804593:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804601:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787360209.804614:0:17190:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009562817s 00010000:00010000:1.0:1787360209.804619:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804625:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804632:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804638:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804651:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360209.804656:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804663:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804685:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360209.804696:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360209.804746:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:3660:x1874182596110592:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360209.804754:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360209.804816:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596110592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360209.804841:0:17221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.804848:0:17221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360209.804854:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70800/0x359a4e2aee721174 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360209.820316:0:17184:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787360209.821066:0:17184:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787360209.821439:0:17247:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000020:00080000:2.0:1787360209.821648:0:17246:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787360209.821652:0:17246:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787360209.821854:0:17247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787360209.822823:0:17184:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1787360209.823432:0:17248:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff998a2edde300 x1874182596110720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360209.823443:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00000040:01000000:1.0:1787360209.823829:0:17184:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787360209.823867:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360209.826907:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787360209.827066:0:17247:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787360209.827474:0:17184:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787360209.827491:0:17184:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787360209.827580:0:17184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360209.828906:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787360209.829629:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787360209.829664:0:17184:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787360209.830729:0:17184:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1787360209.832362:0:17184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787360209.834259:0:17184:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787360209.834290:0:17184:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4f7819c7988 00100000:10000000:1.0:1787360209.834297:0:17184:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787360209.835133:0:17184:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787360209.835148:0:17184:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787360209.835167:0:17184:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787360209.835540:0:17184:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787360209.836305:0:17184:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360209.837652:0:17184:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360210.367016:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360210.809887:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787360210.873358:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 10000000:01000000:2.0:1787360210.876630:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787360210.876638:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a3d61f800 from 7 10000000:01000000:2.0:1787360210.876642:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360210.876688:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360210.876700:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360210.876709:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360210.876731:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596110848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360210.876792:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360210.876922:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110848 00000100:00100000:2.0:1787360210.876925:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3502cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360210.876929:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110848 00000100:00100000:0.0:1787360210.876982:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787360210.876992:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+11:17202:x1874182596110848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360210.877003:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360210.877016:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72117b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360210.877036:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72117b expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360210.877044:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72117b expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360210.877053:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caefc00, rc 0) 00000100:00100000:0.0:1787360210.877088:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17202:x1874182596110848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360210.877107:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787360210.881538:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596110848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360210.881566:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360210.881579:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360210.881652:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596110976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360210.881711:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360210.881756:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360210.886350:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110976 00000100:00100000:0.0:1787360210.886365:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110976 00000100:00100000:0.0:1787360210.886440:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360210.886452:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17202:x1874182596110976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787360210.886475:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787360210.886496:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787360210.886499:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787360210.886623:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17202:x1874182596110976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (4911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360210.886632:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360210.896088:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596110976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360210.896643:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360210.896655:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360210.896667:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360211.385431:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360211.834164:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787360211.898489:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:1.0:1787360212.409409:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360212.923114:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:1.0:1787360213.449882:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787360213.657931:0:17490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787360213.945351:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:1.0:1787360214.458625:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787360214.536877:0:17543:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360214.537144:0:17543:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787360214.969419:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00000100:00080000:0.0:1787360215.290462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360215.290469:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787360215.290472:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360215.290479:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 488 00000100:00100000:3.0:1787360215.291166:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596111104:0@lo:400:kworker.0 00000100:00100000:3.0:1787360215.291262:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360215.291356:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596111104 00000100:00100000:3.0:1787360215.291364:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596111104 00000100:00100000:3.0:1787360215.291414:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360215.291424:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:3661:x1874182596111104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360215.291474:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:3661:x1874182596111104:12345-0@lo:400:kworker.0 Request processed in 52us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360215.291619:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360215.291667:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596111104:0@lo:400:kworker.0 00000100:00080000:0.0:1787360215.292129:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360215.292135:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360215.292160:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edddf80 x1874182596111232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360215.292185:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360215.292188:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360215.292191:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360215.292194:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360215.292209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360215.292212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787360215.292215:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c824000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360215.292220:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff998a3c824000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360215.292265:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddc700 x1874182596111360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360215.292345:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111232:0@lo:38:kworker.0 00000100:00100000:3.0:1787360215.292380:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360215.292403:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596111360:0@lo:38:kworker.0 00000100:00100000:3.0:1787360215.292430:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360215.292469:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596111232 00000100:00100000:3.0:1787360215.292474:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596111232 00000100:00100000:3.0:1787360215.293152:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360215.293160:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596111232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787360215.293187:0:17211:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787360215.293889:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596111360 00000100:00100000:1.0:1787360215.293905:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596111360 00000100:00100000:1.0:1787360215.294483:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360215.294494:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182596111360:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787360215.294530:0:17207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:1.0:1787360215.294578:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x359a4e2aee721189 00000004:00100000:1.0:1787360215.294599:0:17207:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787360215.294811:0:17207:0:(import.c:65:import_set_state_nolock()) ffff9989029fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360215.294927:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1874182596111360:12345-0@lo:38:kworker.0 Request processed in 433us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360215.294935:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787360215.299191:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998a2eddc700 x1874182596111360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360215.299217:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787360215.299247:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787360215.299251:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787360215.299255:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c824000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787360215.299265:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3657:1874182596111360:0@lo:38:kworker.0 00000100:00100000:2.0:1787360215.355358:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596111232:12345-0@lo:38:kworker.0 Request processed in 62191us (62971us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360215.355372:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787360215.356693:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360215.356701:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360215.356706:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111232:0@lo:38:kworker.0 00000020:00000004:0.0:1787360215.381683:0:17593:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360215.381950:0:17593:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787360215.483086:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360215.996814:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:1.0:1787360216.505400:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360217.019418:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:1.0:1787360217.532770:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360218.042477:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:0.0:1787360218.555127:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360219.068421:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00000100:00100000:3.0:1787360219.386470:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360209/real 1787360209] req@ffff998904158e00 x1874182596108160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360219 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360219.386500:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904158e00 x1874182596108160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360219 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360219.386512:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360209/real 1787360209] req@ffff998904158a80 x1874182596108032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360219 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360219.386524:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904158a80 x1874182596108032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360219 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360219.386540:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360219.386595:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360219.386599:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596108160:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787360219.386606:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787360219.388121:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596111488:0@lo:400:kworker.0 00000100:00100000:1.0:1787360219.388201:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360219.388301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360219.388306:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787360219.388310:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360219.388315:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1787360219.388320:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787360219.388325:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360219.388374:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edded80 x1874182596111616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360219.388386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360219.388389:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360219.388390:0:8:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360219.388394:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1787360219.388396:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360219.388400:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9989036e0000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360219.388411:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddea00 x1874182596111744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360219.388435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360219.388438:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360219.388439:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360219.388443:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1787360219.388445:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787360219.388448:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a3c9c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360219.388459:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddd880 x1874182596111872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360219.388483:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787360219.388521:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360219.388590:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112000 00000100:00100000:0.0:1787360219.388598:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112000 00000100:00100000:0.0:1787360219.388644:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360219.388653:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360219.388701:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596112000:12345-0@lo:400:kworker.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360219.388709:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787360219.388741:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998a2eddfb80 x1874182596112000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360219.388754:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596112000:0@lo:400:kworker.0 00000100:00080000:3.0:1787360219.390398:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360219.390408:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596108032:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787360219.390443:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111616:0@lo:38:kworker.0 00000100:00100000:2.0:1787360219.390477:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596111488 00000100:00100000:2.0:1787360219.390485:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596111488 00000100:00100000:3.0:1787360219.390495:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360219.390522:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111744:0@lo:8:kworker.0 00000400:00000100:3.0:1787360219.390545:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596111744 offset 0 length 520: 4 00000100:00100000:3.0:1787360219.390576:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111872:0@lo:8:kworker.0 00000400:00000100:3.0:1787360219.390598:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596111872 offset 0 length 520: 4 00000100:00100000:3.0:1787360219.390623:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596111616 00000100:00100000:3.0:1787360219.390627:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596111616 00000100:00100000:3.0:1787360219.390657:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360219.390664:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596111616:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787360219.390681:0:17210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787360219.390784:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787360219.390792:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:3658:x1874182596111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360219.390844:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:3658:x1874182596111488:12345-0@lo:400:kworker.0 Request processed in 53us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360219.390851:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787360219.391040:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596111488:0@lo:400:kworker.0 00000100:00100000:3.0:1787360219.400050:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3657:x1874182596111616:12345-0@lo:38:kworker.0 Request processed in 9376us (9545us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787360219.400065:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787360219.402784:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360219.402795:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360219.402800:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111616:0@lo:38:kworker.0 00010000:00010000:0.0:1787360219.578054:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360220.099462:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:0.0:1787360220.602387:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360221.051888:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787360221.116303:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:0.0:1787360221.628337:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360222.137313:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:0.0:1787360222.649797:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787360222.687645:0:17938:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787360222.687659:0:17938:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787360222.687660:0:17938:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787360222.687777:0:17938:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9989029fe800 00000020:01000004:1.0:1787360222.687793:0:17938:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787360222.687805:0:17938:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787360222.687818:0:17938:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff998a3505cd28) 00000020:00000080:1.0:1787360222.687837:0:17938:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787360222.737835:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787360222.740167:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.740817:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.741001:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.741212:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.741618:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.742082:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.742334:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.742532:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.742827:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.743022:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.743218:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.743743:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.743956:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.744145:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.744417:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.744895:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.745187:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.745743:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.745984:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.746178:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.746481:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.746695:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.746895:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.747484:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.748167:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.748821:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.749008:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.749315:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.749646:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.749827:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.750055:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787360222.750220:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.750510:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787360222.751761:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.752683:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.753793:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1787360222.754142:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1787360222.754579:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.754860:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.755166:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787360222.755445:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787360222.755694:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1787360222.755968:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.756133:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787360222.756414:0:17938:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1787360222.759441:0:17938:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787360222.759646:0:17938:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787360222.759656:0:17938:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787360222.759667:0:17938:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721197 00000020:01000004:2.0:1787360222.759673:0:17938:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787360222.759691:0:17938:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787360222.759694:0:17938:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787360222.759700:0:17938:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787360222.759724:0:17938:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787360222.759728:0:17938:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1787360222.769494:0:17938:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787360222.769532:0:17938:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1787360222.769536:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787360222.770318:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787360222.770320:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360222.770321:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360222.770322:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360222.770324:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360222.770325:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360222.770327:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360222.770328:0:17938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360222.770331:0:17938:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1787360222.770334:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360222.770335:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787360222.770336:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360222.770337:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360222.770338:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360222.770339:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360222.770347:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360222.770348:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360222.770349:0:17938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360222.770380:0:17938:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787360222.770398:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360222.770463:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.770578:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.773434:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112128 00000100:00100000:0.0:1787360222.773447:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112128 00000100:00100000:0.0:1787360222.773546:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787360222.773557:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17938:x1874182596112128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787360222.773594:0:17198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787360222.773597:0:17198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787360222.773604:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787360222.775660:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17938:x1874182596112128:12345-0@lo:253:mount.lustre.0 Request processed in 2098us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.775672:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787360222.775762:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787360222.775776:0:17938:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787360222.775780:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787360222.775782:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787360222.775783:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360222.775784:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360222.775785:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360222.775787:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360222.775788:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787360222.775790:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360222.775791:0:17938:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787360222.775812:0:17938:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9989029fe800 from lustre-MDT0001 10000000:01000000:3.0:1787360222.775840:0:17938:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787360222.775842:0:17938:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787360222.775848:0:17938:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a35058000 local copy 00010000:00010000:3.0:1787360222.775858:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360222.775958:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360222.775990:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.777157:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.780545:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112256 00000100:00100000:2.0:1787360222.780558:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112256 00000100:00100000:2.0:1787360222.780614:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787360222.780623:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17938:x1874182596112256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360222.780783:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17938:x1874182596112256:12345-0@lo:501:mount.lustre.0 Request processed in 160us (4791us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360222.780791:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360222.782023:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112256:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787360222.782051:0:17938:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787360222.782086:0:17938:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787360222.782104:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.782114:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360222.782140:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9989029fe800 10000000:01000000:3.0:1787360222.782144:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787360222.782149:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff998a35058000 10000000:01000000:3.0:1787360222.782152:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787360222.782155:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff998a35058000 from 1 10000000:01000000:3.0:1787360222.782158:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787360222.782191:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.782200:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.782209:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360222.782317:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360222.782362:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.782390:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.782487:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112384 00000100:00100000:2.0:1787360222.782492:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112384 00000100:00100000:2.0:1787360222.782519:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360222.782525:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+12:17938:x1874182596112384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360222.782553:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360222.782566:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696200/0x359a4e2aee7211a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72119e expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.782584:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696200/0x359a4e2aee7211a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72119e expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.782592:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696200/0x359a4e2aee7211a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72119e expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.782600:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696200, rc 0) 00000100:00100000:2.0:1787360222.782636:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+13:17938:x1874182596112384:12345-0@lo:101:mount.lustre.0 Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.782642:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787360222.785071:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360222.785097:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.785108:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360222.785140:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787360222.785150:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.785156:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a8e00/0x359a4e2aee72119e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211a5 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360222.785166:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9989029fe800 10000000:01000000:3.0:1787360222.785172:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787360222.785177:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9989029fe800 from 1 10000000:01000000:3.0:1787360222.785179:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787360222.785205:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.785213:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.785222:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360222.785272:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360222.785320:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.785346:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.785488:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112512 00000100:00100000:2.0:1787360222.785494:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112512 00000100:00100000:2.0:1787360222.785549:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787360222.785560:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+13:17938:x1874182596112512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360222.785571:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360222.785582:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22697400/0x359a4e2aee7211b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7211ac expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.785602:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697400/0x359a4e2aee7211b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7211ac expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.785611:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22697400/0x359a4e2aee7211b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7211ac expref: 14 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.785619:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22697400, rc 0) 00000100:00100000:2.0:1787360222.785660:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+14:17938:x1874182596112512:12345-0@lo:101:mount.lustre.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.785666:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360222.785995:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360222.786005:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.786012:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360222.786028:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787360222.786042:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.786048:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a8600/0x359a4e2aee7211ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211b3 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360222.786053:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787360222.786056:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360222.786061:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9989029fe800 10000000:01000000:3.0:1787360222.786063:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787360222.786065:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787360222.786067:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787360222.786079:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.786085:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.786091:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360222.786102:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360222.786130:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.786146:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9cacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.786220:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112640 00000100:00100000:2.0:1787360222.786256:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112640 00000100:00100000:2.0:1787360222.786292:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787360222.786298:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+14:17938:x1874182596112640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360222.786304:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360222.786312:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696400/0x359a4e2aee7211c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7211ba expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.786323:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696400/0x359a4e2aee7211c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7211ba expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.786330:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696400/0x359a4e2aee7211c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7211ba expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.786336:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696400, rc 0) 00000100:00100000:2.0:1787360222.786359:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596112640:12345-0@lo:101:mount.lustre.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.786364:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360222.786644:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360222.786654:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360222.786667:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360222.787999:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787360222.788744:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360222.798800:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787360222.798851:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787360222.798866:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787360222.798878:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787360222.798893:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787360222.798905:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787360222.798936:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787360222.798948:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787360222.798959:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787360222.798970:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787360222.798996:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787360222.799006:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787360222.799016:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787360222.799026:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787360222.799035:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787360222.799045:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787360222.799055:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787360222.799064:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787360222.799073:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787360222.799083:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787360222.799092:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787360222.799101:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787360222.799111:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787360222.799131:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787360222.799135:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787360222.799278:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360222.799343:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.799382:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.799669:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112768 00000100:00100000:2.0:1787360222.799676:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112768 00000100:00100000:2.0:1787360222.799722:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360222.799730:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596112768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360222.799854:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596112768:12345-0@lo:501:mount.lustre.0 Request processed in 124us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.799861:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787360222.800513:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360222.800561:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360222.800605:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.800636:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1787360222.800751:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596112896 00000100:00100000:1.0:1787360222.800757:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596112896 00000100:00100000:1.0:1787360222.800795:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787360222.800802:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596112896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360222.801631:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596112896:12345-0@lo:503:mount.lustre.0 Request processed in 827us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360222.801640:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360222.801957:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596112896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787360222.802699:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360222.802777:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596113024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360222.802830:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360222.802866:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.803001:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113024 00000100:00100000:0.0:1787360222.803007:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113024 00000100:00100000:0.0:1787360222.803043:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787360222.803051:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596113024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360222.803675:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596113024:12345-0@lo:502:mount.lustre.0 Request processed in 623us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.803683:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787360222.804085:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596113024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360222.804295:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787360222.804319:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787360222.804329:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787360222.804338:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787360222.804348:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787360222.804357:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787360222.804367:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787360222.804377:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787360222.804400:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787360222.804411:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787360222.804420:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787360222.804429:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787360222.804440:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787360222.804451:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787360222.804462:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787360222.804473:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787360222.804483:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787360222.804503:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787360222.804515:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787360222.804525:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787360222.804553:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787360222.804568:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787360222.804581:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787360222.804593:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787360222.804617:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787360222.804632:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787360222.804645:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787360222.804656:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787360222.804668:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787360222.804679:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787360222.804689:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787360222.804699:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787360222.804710:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787360222.804720:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787360222.804730:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787360222.804740:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787360222.804750:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787360222.804763:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787360222.804776:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787360222.804787:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787360222.804812:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787360222.804827:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787360222.804839:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787360222.804849:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787360222.804876:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596113152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360222.804935:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360222.804968:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1787360222.805219:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113152 00000100:00100000:1.0:1787360222.805257:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113152 00000100:00100000:1.0:1787360222.805300:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787360222.805307:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596113152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.805400:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596113152:12345-0@lo:502:mount.lustre.0 Request processed in 93us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360222.805407:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360222.805782:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596113152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360222.805830:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787360222.805840:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787360222.808013:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.808025:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.808027:0:17942:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787360222.808033:0:17942:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787360222.808035:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360222.808050:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff998a3505b370) 00000020:00000080:1.0:1787360222.808067:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787360222.808071:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787360222.808152:0:17942:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787360222.808162:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee7211cf 00000020:00000080:1.0:1787360222.808397:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787360222.808401:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.808404:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.808406:0:17942:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787360222.808408:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.808411:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.808412:0:17942:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787360222.808415:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360222.808427:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff998a3dcb99b8) 00000020:00000080:1.0:1787360222.808438:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787360222.808442:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787360222.808444:0:17942:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787360222.808447:0:17942:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787360222.808452:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360222.808504:0:17942:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9989029fe800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787360222.808515:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff998a3dcbcd28) 00000020:00000080:1.0:1787360222.808523:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787360222.808598:0:17942:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787360222.808604:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee7211e4 00000020:00000080:1.0:1787360222.808682:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787360222.808687:0:17942:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787360222.808691:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x359a4e2aee7211eb 00080000:01000000:1.0:1787360222.808695:0:17942:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787360222.808697:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee7211f2 00010000:00010000:2.0:1787360222.897728:0:17942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787360222.898637:0:17942:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1787360222.898979:0:17942:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787360222.900898:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787360222.900971:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360222.900978:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360222.900980:0:17942:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787360222.900984:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360222.900989:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360222.900990:0:17942:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787360222.900993:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787360222.900997:0:17942:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:00000080:2.0:1787360222.901020:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360222.901034:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff998a3594cd28) 00000020:00000080:2.0:1787360222.901055:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787360222.901059:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787360222.901140:0:17942:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787360222.901147:0:17942:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787360222.901152:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721200 00010000:00080000:2.0:1787360222.901183:0:17942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a3784b000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787360222.906059:0:17942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787360222.910886:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360222.910901:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787360222.910991:0:17942:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787360222.911012:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721207 00000100:00080000:0.0:1787360222.911021:0:17942:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360222.911026:0:17942:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff998a3784b000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360222.911057:0:17942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edded80 x1874182596113280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360222.911094:0:17942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787360222.911183:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360222.911187:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911189:0:17942:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787360222.911192:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360222.911195:0:17942:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787360222.911197:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.911198:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.911199:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360222.911202:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911203:0:17942:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360222.911206:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360222.911211:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911212:0:17942:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787360222.911216:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787360222.911281:0:17942:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787360222.911297:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360222.911300:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911302:0:17942:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787360222.911304:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360222.911306:0:17942:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1787360222.911307:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.911309:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.911310:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360222.911313:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911314:0:17942:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360222.911316:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360222.911319:0:17942:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787360222.911322:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.911323:0:17942:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787360222.911326:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360222.911329:0:17942:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1787360222.911356:0:17942:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787360222.911359:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360222.911370:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff998a3c903370) 00000020:00000080:0.0:1787360222.911383:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787360222.911388:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360222.911453:0:17942:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787360222.911459:0:17942:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787360222.911465:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721215 00010000:00080000:0.0:1787360222.911717:0:17942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998902614000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360222.911899:0:17942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1787360222.912361:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787360222.912422:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1787360222.913060:0:17942:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360222.913822:0:17942:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787360222.915141:0:17942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360222.915439:0:17942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787360222.915779:0:17942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1787360222.916119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787360222.916124:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787360222.916127:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360222.916134:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:2.0:1787360222.916144:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787360222.916150:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360222.916180:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903948000 x1874182596113408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360222.916208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.916212:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360222.916215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.916218:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360222.916290:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113280 00000100:00100000:2.0:1787360222.916297:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113280 00000100:00100000:2.0:1787360222.916334:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360222.916342:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3657:x1874182596113280:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787360222.916366:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1787360222.916397:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee72121c 00000004:00100000:2.0:1787360222.916411:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787360222.916416:0:17211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787360222.916478:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596113536:0@lo:400:kworker.0 00000100:00100000:2.0:1787360222.916678:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.916843:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596113408:0@lo:38:kworker.0 00000100:00100000:1.0:1787360222.916872:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.916899:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113536 00000100:00100000:1.0:1787360222.916902:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113536 00000100:00100000:1.0:1787360222.916950:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360222.916957:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360222.917001:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596113536:12345-0@lo:400:kworker.0 Request processed in 45us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360222.917013:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787360222.917045:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99890394b480 x1874182596113536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360222.917056:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596113536:0@lo:400:kworker.0 00000100:00100000:2.0:1787360222.917171:0:17210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787360222.917179:0:17210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787360222.918391:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113408 00000100:00100000:2.0:1787360222.918398:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113408 00000100:00100000:0.0:1787360222.918548:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360222.918555:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596113408:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787360222.918629:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596113408:12345-0@lo:38:kworker.0 Request processed in 73us (1755us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787360222.918636:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360222.918740:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787360222.918747:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360222.918751:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787360222.918755:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596113408:0@lo:38:kworker.0 00000040:00080000:3.0:1787360222.919125:0:17947:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787360222.919130:0:17947:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787360222.920380:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787360222.920393:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787360222.920431:0:17942:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787360222.920451:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721223 00000100:00080000:0.0:1787360222.920458:0:17942:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360222.920464:0:17942:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360222.920489:0:17942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddfb80 x1874182596113664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360222.920521:0:17942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787360222.920632:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113664:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787360222.920675:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596113664 offset 0 length 520: 4 00000020:01000000:0.0:1787360222.920813:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360222.920817:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.920818:0:17942:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787360222.920821:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360222.920823:0:17942:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787360222.920825:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.920826:0:17942:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360222.920828:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360222.920829:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.920830:0:17942:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360222.920833:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360222.920836:0:17942:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787360222.920839:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360222.920840:0:17942:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787360222.920842:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360222.920846:0:17942:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.111@tcp to nid 0x20000c0a8ce6f (192.168.206.111@tcp) 00000020:01000000:0.0:1787360222.920865:0:17942:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787360222.920868:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360222.920878:0:17942:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff998a3c9019b8) 00000020:00000080:0.0:1787360222.920891:0:17942:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787360222.920896:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:2.0:1787360222.921011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.921015:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360222.921018:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.921027:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000004:00080000:0.0:1787360222.921988:0:17942:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787360222.921996:0:17942:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787360222.922004:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x359a4e2aee721231 00010000:00080000:0.0:1787360222.922045:0:17942:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a042fe000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.111@tcp at head 00000100:00080000:1.0:1787360222.923198:0:17211:0:(import.c:65:import_set_state_nolock()) ffff998902a5f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360222.923316:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596113280:12345-0@lo:38:llog_process_th.0 Request processed in 6972us (10891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360222.923329:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360222.923476:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360222.923485:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787360222.923502:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787360222.923506:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787360222.923509:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3784b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360222.923517:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360222.924198:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596113792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360222.924280:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360222.924320:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596113792 00000100:00100000:2.0:1787360222.924326:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596113792 00000100:00100000:2.0:1787360222.924365:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360222.924373:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1874182596113792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360222.924397:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360222.924431:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3661:x1874182596113792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.924437:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360222.924464:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596113792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787360222.925404:0:17942:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787360222.925467:0:17942:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360222.925480:0:17942:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787360222.931509:0:17942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360222.932090:0:17942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787360222.932199:0:17942:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787360222.933117:0:17950:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787360222.933123:0:17950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787360222.950042:0:17942:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787360222.950056:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787360222.950096:0:17942:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787360222.950116:0:17942:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721238 00000100:00080000:1.0:1787360222.950125:0:17942:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360222.950130:0:17942:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360222.950159:0:17942:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890415b800 x1874182596113920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360222.950249:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113920:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787360222.950305:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596113920 offset 0 length 520: 4 00000100:00080000:1.0:1787360222.950374:0:17942:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787360222.950431:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.950446:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.950447:0:17942:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787360222.950451:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.950455:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.950456:0:17942:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787360222.950459:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787360222.950461:0:17942:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787360222.950463:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.950465:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.950466:0:17942:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787360222.950468:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.950470:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.950471:0:17942:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787360222.950474:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787360222.950513:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.950516:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.950517:0:17942:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787360222.950519:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1787360222.950876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.950881:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360222.950884:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360222.950887:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1787360222.951448:0:17938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787360222.951485:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787360222.951510:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.951521:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a9000/0x359a4e2aee7211ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7211c1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360222.951528:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9989029fe800 from 1 10000000:01000000:2.0:1787360222.951673:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360222.951699:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.951707:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.951716:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360222.951733:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360222.951780:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360222.951813:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.952007:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114048 00000100:00100000:0.0:1787360222.952019:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114048 00000100:00100000:0.0:1787360222.952066:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787360222.952075:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+15:17938:x1874182596114048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360222.952087:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360222.952098:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72123f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.952117:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72123f expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.952126:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72123f expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.952133:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee800, rc 0) 00000100:00100000:0.0:1787360222.952166:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17938:x1874182596114048:12345-0@lo:101:mount.lustre.0 Request processed in 92us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.952172:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360222.955890:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360222.955927:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.955940:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360222.956819:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114176:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787360222.956889:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360222.956939:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.957014:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114176 00000100:00100000:0.0:1787360222.957022:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114176 00000100:00100000:0.0:1787360222.957070:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787360222.957079:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17938:x1874182596114176:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787360222.957097:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787360222.957114:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787360222.957116:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787360222.957205:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17938:x1874182596114176:12345-0@lo:256:mount.lustre.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.957213:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787360222.957368:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114176:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787360222.957935:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787360222.957957:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360222.957967:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360222.957975:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9989029fe800 from 1 10000000:01000000:1.0:1787360222.957978:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360222.958005:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360222.958014:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360222.958046:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360222.958062:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360222.958092:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.958120:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.958317:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114304 00000100:00100000:2.0:1787360222.958323:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114304 00000100:00100000:2.0:1787360222.958399:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787360222.958407:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17938:x1874182596114304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360222.958417:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360222.958433:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72124d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.958452:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.958461:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360222.958468:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696c00, rc 0) 00000100:00100000:2.0:1787360222.958517:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114304:12345-0@lo:101:mount.lustre.0 Request processed in 111us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360222.958524:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787360222.958855:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360222.958868:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360222.958876:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360222.958999:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360222.959029:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360222.959056:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.962216:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.964720:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114432 00000100:00100000:0.0:1787360222.964735:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114432 00000100:00100000:0.0:1787360222.964973:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787360222.964983:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360222.965149:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114432:12345-0@lo:501:mount.lustre.0 Request processed in 168us (6092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.965157:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787360222.965383:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360222.965426:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360222.965465:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.965487:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.965698:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114560 00000100:00100000:0.0:1787360222.965703:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114560 00000100:00100000:0.0:1787360222.965722:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787360222.965727:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360222.965814:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114560:12345-0@lo:503:mount.lustre.0 Request processed in 86us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.965821:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787360222.965893:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360222.966217:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360222.966344:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.966387:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.966414:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787360222.966432:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114688 00000100:00100000:1.0:1787360222.966437:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114688 00000100:00100000:1.0:1787360222.966457:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360222.966464:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.966773:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114688:12345-0@lo:502:mount.lustre.0 Request processed in 309us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360222.966781:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360222.966825:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360222.967043:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787360222.967067:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787360222.967080:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787360222.967093:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787360222.967105:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787360222.967117:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787360222.967129:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787360222.967141:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787360222.967152:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787360222.967164:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787360222.967178:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787360222.967200:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.968021:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.968108:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ab8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787360222.968684:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114816 00000100:00100000:2.0:1787360222.968694:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114816 00000100:00100000:0.0:1787360222.969014:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787360222.969026:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360222.969154:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114816:12345-0@lo:502:mount.lustre.0 Request processed in 131us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.969162:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360222.969304:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360222.969377:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787360222.969388:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787360222.970148:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.970156:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970159:0:17952:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787360222.970165:0:17952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9989029fe800 00000020:00000080:1.0:1787360222.970167:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360222.970174:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.970176:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970178:0:17952:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787360222.970180:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.970182:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970183:0:17952:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787360222.970187:0:17952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9989029fe800 00000020:00000080:1.0:1787360222.970188:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360222.970271:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.970275:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970276:0:17952:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787360222.970279:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.970281:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970282:0:17952:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360222.970285:0:17952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9989029fe800 00000020:00000080:1.0:1787360222.970287:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360222.970303:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.970306:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970307:0:17952:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360222.970309:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360222.970311:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970313:0:17952:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787360222.970316:0:17952:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9989029fe800 00000020:00000080:1.0:1787360222.970318:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360222.970347:0:17952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360222.970350:0:17952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360222.970351:0:17952:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787360222.970354:0:17952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1787360222.977440:0:17938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787360222.977484:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360222.977501:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.977514:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360222.978015:0:17938:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360222.978019:0:17938:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9989029fe800 10000000:01000000:0.0:1787360222.978028:0:17938:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9989029fe800 10000000:01000000:0.0:1787360222.978032:0:17938:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360222.978038:0:17938:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9989029fe800 from 1 10000000:01000000:0.0:1787360222.978041:0:17938:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360222.978073:0:17938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.978082:0:17938:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.978094:0:17938:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360222.978117:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360222.978178:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360222.978216:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596114944 00000100:00100000:0.0:1787360222.978222:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596114944 00000100:00100000:0.0:1787360222.979043:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360222.979054:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17938:x1874182596114944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360222.979068:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360222.979081:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caee000/0x359a4e2aee721262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72125b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.979106:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caee000/0x359a4e2aee721262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72125b expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.979116:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caee000/0x359a4e2aee721262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72125b expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.979125:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee000, rc 0) 00000100:00100000:0.0:1787360222.979174:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596114944:12345-0@lo:101:mount.lustre.0 Request processed in 122us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.979181:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360222.980313:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902a9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.980345:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596114944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360222.980365:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360222.980375:0:17938:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360222.983058:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787360222.984492:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360222.985140:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787360222.985169:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1787360222.985200:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1787360222.985215:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1787360222.987660:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1787360222.987703:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1787360222.987714:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1787360222.987723:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1787360222.987734:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1787360222.987743:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1787360222.989347:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1787360222.989388:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1787360222.989401:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1787360222.989413:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1787360222.989426:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1787360222.989437:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1787360222.989451:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1787360222.989465:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1787360222.989503:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1787360222.989519:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1787360222.989532:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1787360222.990337:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1787360222.990355:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1787360222.990366:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1787360222.990376:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1787360222.990387:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1787360222.990396:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1787360222.990406:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1787360222.990426:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1787360222.990430:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787360222.990522:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360222.991364:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360222.991413:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902a9f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360222.991475:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115072 00000100:00100000:3.0:1787360222.991483:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115072 00000100:00100000:3.0:1787360222.991528:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360222.991537:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360222.991663:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115072:12345-0@lo:501:mount.lustre.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360222.991670:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787360222.991725:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360222.991759:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360222.991801:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360222.991828:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902a9f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360222.991842:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115200 00000100:00100000:3.0:1787360222.991846:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115200 00000100:00100000:3.0:1787360222.991868:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360222.991874:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360222.992060:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115200:12345-0@lo:503:mount.lustre.0 Request processed in 184us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360222.992089:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360222.992335:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360222.993508:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360222.994679:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.995734:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.995781:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573240 going to sleep for 11 seconds 00000100:00100000:0.0:1787360222.995850:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115328 00000100:00100000:0.0:1787360222.995857:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115328 00000100:00100000:0.0:1787360222.996642:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787360222.996655:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360222.996796:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115328:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360222.996804:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787360222.997054:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360222.997283:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787360222.997313:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1787360222.997329:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1787360222.997344:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1787360222.997357:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1787360222.997371:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1787360222.997384:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1787360222.997398:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1787360222.997412:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1787360222.997426:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1787360222.997455:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1787360222.997472:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1787360222.997485:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1787360222.997498:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1787360222.997512:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1787360222.997525:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1787360222.999292:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1787360222.999332:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1787360222.999345:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1787360222.999356:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1787360222.999366:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1787360222.999377:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1787360222.999387:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1787360222.999399:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1787360222.999411:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1787360222.999436:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1787360222.999464:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1787360222.999480:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1787360222.999492:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1787360222.999502:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1787360222.999512:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1787360222.999521:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1787360222.999531:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1787360222.999540:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1787360222.999550:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1787360222.999560:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1787360222.999570:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1787360222.999580:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1787360222.999590:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1787360222.999599:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1787360222.999608:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1787360222.999619:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1787360222.999639:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1787360222.999650:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1787360222.999660:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1787360222.999670:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1787360222.999680:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1787360222.999690:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1787360222.999736:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360222.999797:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360222.999832:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360222.999857:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115456 00000100:00100000:1.0:1787360222.999862:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115456 00000100:00100000:1.0:1787360222.999902:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787360222.999909:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360223.000004:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115456:12345-0@lo:502:mount.lustre.0 Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360223.000014:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787360223.000060:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360223.000186:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1787360223.000206:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1787360223.000253:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360223.000292:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360223.000311:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360223.000324:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115584 00000100:00100000:1.0:1787360223.000328:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115584 00000100:00100000:1.0:1787360223.000349:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360223.000354:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360223.000414:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115584:12345-0@lo:502:mount.lustre.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360223.000420:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787360223.000459:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360223.000497:0:17938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1787360223.000507:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787360223.001309:0:17957:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787360223.001323:0:17957:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff998a3dcb8000) 00000020:00000080:1.0:1787360223.001342:0:17957:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787360223.001424:0:17957:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9989029fe800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787360223.001428:0:17957:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9989029fe800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787360223.001431:0:17957:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9989029fe800 3 00010000:00080000:1.0:1787360223.001464:0:17957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a05894000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.111@tcp at head 00010000:00010000:1.0:1787360223.008730:0:17957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787360223.008951:0:17957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787360223.008997:0:17957:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787360223.009009:0:17957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x359a4e2aee721270 00000100:00080000:1.0:1787360223.009018:0:17957:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360223.009024:0:17957:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff998a05894000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360223.009057:0:17957:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904158380 x1874182596115712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360223.009089:0:17957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787360223.009117:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360223.009122:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360223.009124:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360223.009127:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787360223.009379:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596115712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360223.009447:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360223.009559:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115712 00000100:00100000:1.0:1787360223.009565:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115712 00000100:00100000:1.0:1787360223.009606:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787360223.009613:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596115712:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787360223.009634:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1787360223.009677:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x359a4e2aee721277 00000004:00100000:1.0:1787360223.009692:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787360223.009718:0:17206:0:(import.c:65:import_set_state_nolock()) ffff998a05897000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360223.009769:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1874182596115712:12345-0@lo:38:llog_process_th.0 Request processed in 156us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360223.009776:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787360223.009810:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998904158380 x1874182596115712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360223.009820:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787360223.009832:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787360223.009839:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787360223.009842:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787360223.009844:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a05894000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787360223.009850:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3657:1874182596115712:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787360223.010095:0:17957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1787360223.010349:0:17938:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787360223.010376:0:17938:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787360223.010395:0:17938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.010404:0:17938:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefe00/0x359a4e2aee72125b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721262 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787360223.010446:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787360223.010449:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787360223.010450:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360223.010451:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360223.010452:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360223.010454:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360223.010460:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360223.010461:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360223.010462:0:17938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787360223.010466:0:17938:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787360223.010468:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360223.010469:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787360223.010470:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360223.010471:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360223.010472:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360223.010473:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360223.010474:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360223.010475:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360223.010476:0:17938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787360223.010490:0:17938:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787360223.010502:0:17938:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360223.010551:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.010572:0:17938:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360223.010655:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115840 00000100:00100000:1.0:1787360223.010661:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115840 00000100:00100000:1.0:1787360223.010698:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787360223.010704:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787360223.010723:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787360223.010734:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787360223.011791:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787360223.011969:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787360223.011985:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787360223.012107:0:17221:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787360223.012112:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787360223.012131:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012147:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72117b expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012154:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72123f expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012161:0:17221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012190:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012214:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 18 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360223.012243:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596115968:0@lo:104: 00000100:00100000:2.0:1787360223.012299:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360223.012339:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.012347:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 18 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360223.012356:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596116096:0@lo:104: 00000100:00100000:2.0:1787360223.012376:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.012391:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360223.012425:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596115968 00000100:00100000:2.0:1787360223.012430:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596115968 00000100:00100000:2.0:1787360223.012455:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116096 00000100:00100000:2.0:1787360223.012458:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116096 00000100:00100000:2.0:1787360223.012470:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360223.012478:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596115968:12345-0@lo:104: 00010000:00010000:2.0:1787360223.012489:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360223.012683:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17938:x1874182596115840:12345-0@lo:253:mount.lustre.0 Request processed in 1977us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360223.012692:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787360223.012741:0:17938:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17938:1874182596115840:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787360223.012751:0:17938:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787360223.012753:0:17938:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787360223.012755:0:17938:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787360223.012756:0:17938:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360223.012757:0:17938:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360223.012758:0:17938:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360223.012759:0:17938:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360223.012760:0:17938:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787360223.012762:0:17938:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360223.012763:0:17938:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787360223.012777:0:17938:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787360223.012943:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787360223.012950:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596115968:12345-0@lo:104: Request processed in 472us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.012956:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360223.012972:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360223.012986:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596116096:12345-0@lo:104: 00010000:00010000:2.0:1787360223.012993:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013173:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360223.013179:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013193:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360223.013197:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013206:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360223.013213:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360223.013218:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360223.013269:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013276:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360223.013294:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013300:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22697a00/0x359a4e2aee72123f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721246 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.013312:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360223.013314:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360223.013316:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360223.013412:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787360223.013418:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596116096:12345-0@lo:104: Request processed in 433us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.013425:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360223.013455:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596115968:0@lo:104: 00000100:00100000:2.0:1787360223.013464:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596116096:0@lo:104: 00010000:00010000:2.0:1787360223.013478:0:17221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360223.016217:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596116224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360223.017016:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787360223.017108:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360223.017115:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.017130:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360223.017134:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.017143:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360223.017150:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360223.017164:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360223.017195:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.017201:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360223.017215:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.017220:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a22696000/0x359a4e2aee72117b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721182 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360223.017251:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360223.017252:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360223.017254:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360223.017303:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596116352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360223.017329:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.022991:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116224 00000100:00100000:2.0:1787360223.023003:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116224 00010000:00010000:2.0:1787360223.023044:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 18 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360223.023080:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116352 00000100:00100000:2.0:1787360223.023084:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116352 00010000:00010000:2.0:1787360223.023094:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 19 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360223.023108:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360223.023116:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3658:x1874182596116224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360223.023128:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360223.023133:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 19 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023154:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 19 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023183:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caee800/0x359a4e2aee721246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72123f expref: 19 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023198:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360223.023284:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3658:x1874182596116224:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (6268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.023291:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360223.023307:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360223.023312:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:3659:x1874182596116352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360223.023320:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360223.023324:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 17 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023332:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 17 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023342:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caefc00/0x359a4e2aee721182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72117b expref: 17 pid: 17199 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023354:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023363:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787360223.023377:0:17191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011265149s 00010000:00010000:2.0:1787360223.023386:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023393:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023400:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023407:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023413:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360223.023417:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023425:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023438:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023448:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360223.023463:0:17221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023470:0:17221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360223.023476:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697800/0x359a4e2aee72127e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360223.023820:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596116224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360223.023872:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:3659:x1874182596116352:12345-0@lo:103:ldlm_bl.0 Request processed in 559us (6541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.023879:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360223.023904:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596116352:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1787360223.030190:0:17938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787360223.030363:0:17962:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787360223.030366:0:17962:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787360223.031214:0:17964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360223.031248:0:17938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1787360223.031786:0:17964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360223.034690:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.034753:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.034787:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116480 00000100:00100000:2.0:1787360223.034793:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116480 00000100:00100000:2.0:1787360223.034829:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360223.034838:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116480:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.034902:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000040:01000000:3.0:1787360223.034955:0:17938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787360223.034992:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787360223.035521:0:17938:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787360223.035529:0:17938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787360223.035564:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360223.035728:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360223.035760:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360223.035781:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116480:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787360223.035805:0:17965:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787360223.035830:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.035861:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.035880:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116608 00000100:00100000:2.0:1787360223.035884:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116608 00000100:00100000:2.0:1787360223.035904:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360223.036222:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.036327:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 108us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.036334:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360223.036355:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360223.036366:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.036406:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17965:1874182596116736:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.036428:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.036441:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee996c0 going to sleep for 11 seconds 00000040:00080000:3.0:1787360223.036613:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1787360223.036729:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116736 00000100:00100000:1.0:1787360223.036734:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116736 00000100:00100000:1.0:1787360223.036765:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360223.036771:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1874182596116736:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787360223.036807:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17965:x1874182596116736:12345-0@lo:900:lod0001_rec0000.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360223.036813:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787360223.037123:0:17964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1787360223.037163:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787360223.037187:0:17938:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:2.0:1787360223.037277:0:17965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff998903949f80 x1874182596116736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360223.037288:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17965:1874182596116736:0@lo:900:lod0001_rec0000.0 00000040:00080000:3.0:1787360223.037304:0:17938:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360223.037331:0:17965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116864:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.037358:0:17965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360223.037378:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116864 00000100:00100000:2.0:1787360223.037381:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116864 00000100:00100000:2.0:1787360223.037402:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360223.037408:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116864:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787360223.037451:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17965:x1874182596116864:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 43us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360223.037456:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360223.037471:0:17965:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360223.037482:0:17965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17965:1874182596116864:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787360223.037515:0:17965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787360223.037631:0:17964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1787360223.042367:0:17938:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1787360223.050018:0:17938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1787360223.051935:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787360223.052013:0:17965:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787360223.052018:0:17965:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1787360223.063107:0:17938:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787360223.063141:0:17938:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4f781463988 00100000:10000000:3.0:1787360223.063148:0:17938:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787360223.065002:0:17938:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787360223.065029:0:17938:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787360223.065048:0:17938:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787360223.065069:0:17938:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787360223.073211:0:17938:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360223.073444:0:17938:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787360223.166742:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:3.0:1787360223.684741:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360224.060819:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787360224.185543:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:0.0:1787360224.697462:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787360224.959408:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360224.959418:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9989029fe800 from 8 10000000:01000000:0.0:1787360224.959425:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360224.959488:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360224.959503:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360224.959521:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360224.960491:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596116992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360224.960605:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360224.960668:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996180 going to sleep for 11 seconds 00000100:00100000:2.0:1787360224.961429:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596116992 00000100:00100000:2.0:1787360224.961461:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596116992 00000100:00100000:2.0:1787360224.961523:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787360224.961548:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17202:x1874182596116992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360224.961570:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360224.961600:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721285 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360224.961633:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721285 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360224.961645:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721285 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360224.961656:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a22696000, rc 0) 00000100:00100000:2.0:1787360224.961734:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596116992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360224.961742:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360224.963157:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596116992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360224.963185:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360224.963199:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360224.963316:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360224.963391:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360224.963435:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360224.963593:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117120 00000100:00100000:1.0:1787360224.963599:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117120 00000100:00100000:1.0:1787360224.963645:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787360224.963653:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596117120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787360224.963672:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787360224.963689:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787360224.963692:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787360224.963774:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596117120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360224.963782:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360224.963916:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360224.963957:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360224.963970:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360224.963978:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360224.963987:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787360224.963990:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a3d61f800 from 8 10000000:01000000:3.0:1787360224.963993:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787360224.964025:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360224.964033:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360224.964042:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360224.964055:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360224.964080:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360224.964107:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360224.964152:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117248 00000100:00100000:1.0:1787360224.964157:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117248 00000100:00100000:1.0:1787360224.964190:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787360224.964198:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596117248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360224.964206:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360224.964266:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721293 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360224.964285:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721293 expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360224.964295:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721293 expref: 18 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360224.964303:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71e00, rc 0) 00000100:00100000:1.0:1787360224.964335:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596117248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360224.964341:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787360224.964434:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360224.964461:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360224.964474:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360224.964562:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787360224.964638:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360224.964679:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902996240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360224.964762:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117376 00000100:00100000:1.0:1787360224.964768:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117376 00000100:00100000:1.0:1787360224.964801:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787360224.964808:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596117376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787360224.964821:0:17197:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787360224.964835:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787360224.964838:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787360224.964924:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596117376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360224.964931:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787360224.965025:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596117376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360224.965068:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360224.965075:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360224.965082:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360225.082080:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787360225.209485:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:3.0:1787360225.729376:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360226.233288:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00010000:00010000:3.0:1787360226.755701:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360227.258291:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 0 seconds 00000001:02000400:2.0:1787360227.571048:0:18207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787360227.770613:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360228.090111:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360228.090131:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596117504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360228.090196:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360228.090278:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117504 00000100:00100000:3.0:1787360228.090286:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117504 00000100:00100000:3.0:1787360228.090329:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360228.090347:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596117504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360228.090381:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360228.090425:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596117504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.090431:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360228.090475:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596117504:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787360228.091825:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787360228.091831:0:14779:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787360228.091834:0:14779:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360228.091853:0:14779:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff998a19704000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360228.091876:0:14779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2eddc380 x1874182596117760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360228.091894:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360228.091898:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360228.091901:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360228.091903:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360228.091922:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360228.091925:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360228.092018:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596117632:0@lo:400:kworker.0 00000100:00100000:1.0:1787360228.092081:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360228.092130:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117632 00000100:00100000:1.0:1787360228.092136:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117632 00000100:00100000:1.0:1787360228.092174:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360228.092182:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3661:x1874182596117632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360228.092264:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3661:x1874182596117632:12345-0@lo:400:kworker.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360228.092272:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360228.092315:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596117632:0@lo:400:kworker.0 00000100:00080000:0.0:1787360228.092581:0:14779:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360228.092584:0:14779:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360228.092616:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596117760:0@lo:38:kworker.0 00000100:00100000:0.0:1787360228.092647:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360228.092693:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596117888:0@lo:400:kworker.0 00000100:00100000:0.0:1787360228.092720:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360228.092742:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360228.092748:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596118016:0@lo:400:kworker.0 00000100:00100000:0.0:1787360228.092772:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360228.092803:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117888 00000100:00100000:0.0:1787360228.092807:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117888 00000100:00100000:0.0:1787360228.092847:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118016 00000100:00100000:0.0:1787360228.092850:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118016 00000100:00100000:0.0:1787360228.092874:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360228.092880:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596117888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360228.092918:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596117888:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360228.092925:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360228.093012:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596117760 00000100:00100000:3.0:1787360228.093016:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596117760 00000100:00100000:3.0:1787360228.093050:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360228.093055:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3657:x1874182596117760:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787360228.093081:0:17948:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787360228.093115:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7212a1 00000004:00100000:3.0:1787360228.093128:0:17948:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787360228.093133:0:17948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787360228.093529:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360228.093538:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360228.093576:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596118016:12345-0@lo:400:kworker.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360228.093582:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787360228.094927:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2eddc000 x1874182596118016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360228.095550:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596118016:0@lo:400:kworker.0 00010000:00080000:0.0:1787360228.095569:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2eddca80 x1874182596117888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360228.095577:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596117888:0@lo:400:kworker.0 00000100:00080000:3.0:1787360228.105282:0:17948:0:(import.c:65:import_set_state_nolock()) ffff998a059e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360228.105564:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596117760:12345-0@lo:38:kworker.0 Request processed in 12503us (12911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.105576:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787360228.105593:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787360228.105604:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787360228.105609:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787360228.105612:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a19704000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787360228.105636:0:3657:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e25c36be): req@ffff998a2edde300 x1874182596110720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360228.105656:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596117760:0@lo:38:kworker.0 00000100:00100000:1.0:1787360228.105726:0:17248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360228.105748:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998902ad8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360228.106253:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596110720 00000100:00100000:3.0:1787360228.106260:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596110720 00000100:00100000:3.0:1787360228.106299:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360228.106309:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596110720:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360228.106452:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596118144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360228.106488:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360228.106952:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596110720:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 643us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.106961:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360228.106980:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118144 00000100:00100000:1.0:1787360228.106992:0:17248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17248:1874182596110720:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787360228.106993:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118144 00000100:00100000:3.0:1787360228.107016:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360228.107024:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596118144:12345-0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1787360228.107035:0:17248:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787360228.107072:0:17248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17248:1874182596118272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360228.107103:0:17248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360228.107130:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a203aad80 going to sleep for 11 seconds 00000004:00000024:3.0:1787360228.107467:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360228.107637:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596118144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 613us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.107644:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360228.107656:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118272 00000100:00100000:3.0:1787360228.107659:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118272 00000100:00100000:3.0:1787360228.107673:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360228.107678:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596118272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787360228.108616:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596118272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 935us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.108624:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360228.108971:0:17248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17248:1874182596118272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787360228.109125:0:17248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17248:1874182596118400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787360228.109160:0:17248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360228.109186:0:17248:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a13dec600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360228.109320:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118400 00000100:00100000:3.0:1787360228.109325:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118400 00000100:00100000:3.0:1787360228.109551:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360228.109561:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596118400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787360228.109626:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17248:x1874182596118400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360228.109633:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360228.111494:0:17248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17248:1874182596118400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787360228.111503:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596118144:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1787360228.111558:0:17248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360228.118167:0:17248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787360228.118453:0:17248:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1787360228.118469:0:17248:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1787360228.391531:0:18260:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360228.391718:0:18260:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360228.795681:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787360229.277957:0:18311:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360229.278133:0:18311:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360229.821186:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787360230.071965:0:18359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4c697450 20000000:00000080:0.0:1787360230.071982:0:18359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a0431cc00 uarg=0000000000000000 20000000:01000000:0.0:1787360230.072019:0:18359:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787360230.072026:0:18359:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787360230.072031:0:18359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787360230.072825:0:18360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787360230.072987:0:18359:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787360230.080532:0:18359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787360230.080561:0:18359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080579:0:18359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72114a expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080586:0:18359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080593:0:18359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080637:0:18359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080653:0:18359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360230.080668:0:18359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1874182596118528:0@lo:104: 00000100:00100000:0.0:1787360230.080735:0:18359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787360230.080784:0:18359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.080793:0:18359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 17 pid: 17198 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360230.080816:0:18359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1874182596118656:0@lo:104: 00000100:00100000:0.0:1787360230.080840:0:18359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360230.080858:0:18359:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360230.081108:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118528 00000100:00100000:3.0:1787360230.081116:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118528 00000100:00100000:3.0:1787360230.081153:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118656 00000100:00100000:3.0:1787360230.081156:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118656 00000100:00100000:3.0:1787360230.081170:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360230.081186:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:18359:x1874182596118528:12345-0@lo:104: 00010000:00010000:3.0:1787360230.081197:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081288:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360230.081294:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:18359:x1874182596118528:12345-0@lo:104: Request processed in 110us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360230.081301:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360230.081318:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360230.081325:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:18359:x1874182596118656:12345-0@lo:104: 00010000:00010000:3.0:1787360230.081333:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081377:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787360230.081383:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:18359:x1874182596118656:12345-0@lo:104: Request processed in 59us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360230.081389:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787360230.081405:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360230.081410:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081417:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360230.081421:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081429:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360230.081436:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360230.081449:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360230.081478:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081485:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360230.081502:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081509:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b70800/0x359a4e2aee72124d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721254 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081520:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360230.081523:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081528:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360230.081531:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081538:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360230.081544:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360230.081549:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787360230.081559:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081565:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360230.081584:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081590:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caef000/0x359a4e2aee72114a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721151 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081602:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360230.081604:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360230.081606:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360230.081612:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360230.081628:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596118784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360230.081656:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360230.081686:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596118912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360230.081705:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360230.081730:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118784 00000100:00100000:3.0:1787360230.081734:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118784 00010000:00010000:3.0:1787360230.081749:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 18 pid: 17197 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360230.081764:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596118912 00000100:00100000:3.0:1787360230.081766:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596118912 00010000:00010000:3.0:1787360230.081774:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 19 pid: 17198 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360230.081783:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360230.081788:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3661:x1874182596118784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360230.081796:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360230.081800:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 19 pid: 17197 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081818:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 19 pid: 17197 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081832:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360230.081856:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:3661:x1874182596118784:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360230.081863:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360230.081891:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360230.081897:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3658:x1874182596118912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360230.081904:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360230.081908:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 18 pid: 17198 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081917:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 18 pid: 17198 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081928:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081936:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081947:0:17190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081954:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081960:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081972:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081978:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360230.081981:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081989:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.081997:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.082007:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360230.082036:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3658:x1874182596118912:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360230.082042:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360230.082076:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596118912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360230.082099:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596118784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360230.082575:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696c00/0x359a4e2aee721254 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72124d expref: 17 pid: 17197 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360230.082588:0:18359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1874182596118528:0@lo:104: 00010000:00010000:0.0:1787360230.082599:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22697e00/0x359a4e2aee721151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee72114a expref: 16 pid: 17198 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360230.082606:0:18359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1874182596118656:0@lo:104: 00010000:00010000:0.0:1787360230.082620:0:18359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.082629:0:18359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.082634:0:18359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360230.082639:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a3caef800/0x359a4e2aee7212a8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360230.843563:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787360231.097332:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360231.097338:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9989029fe800 from 13 10000000:01000000:3.0:1787360231.097342:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360231.097382:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360231.097392:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360231.097415:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360231.097438:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360231.097501:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360231.097548:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360231.097549:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119040 00000100:00100000:1.0:1787360231.097559:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119040 00000100:00100000:1.0:1787360231.097615:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787360231.097625:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+16:17202:x1874182596119040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360231.097638:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360231.097651:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7212af expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.097673:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7212af expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.097684:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212af expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.097692:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70600, rc 0) 00000100:00100000:1.0:1787360231.097738:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360231.097746:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360231.097885:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360231.097899:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360231.097909:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360231.098058:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360231.098494:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360231.098520:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360231.098539:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119168 00000100:00100000:2.0:1787360231.098544:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119168 00000100:00100000:2.0:1787360231.098587:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787360231.098596:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360231.098787:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360231.098795:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787360231.098879:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360231.098909:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360231.098949:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360231.098970:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360231.099025:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119296 00000100:00100000:1.0:1787360231.099030:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119296 00000100:00100000:1.0:1787360231.099062:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787360231.099069:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360231.099157:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360231.099175:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360231.099178:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787360231.101712:0:18404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787360231.106695:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787360231.106732:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360231.106745:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.106756:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360231.106829:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787360231.106833:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61f800 from 13 10000000:01000000:0.0:1787360231.106836:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360231.106938:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360231.106946:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360231.106957:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360231.106982:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360231.107041:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360231.108881:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360231.113579:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119424 00000100:00100000:1.0:1787360231.113592:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119424 00000100:00100000:1.0:1787360231.113655:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787360231.113666:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+17:17202:x1874182596119424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360231.113682:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360231.113699:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7212bd expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.113726:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.113738:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360231.113748:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70000, rc 0) 00000100:00100000:1.0:1787360231.113825:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596119424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (6784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360231.113833:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787360231.113969:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360231.113987:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360231.113996:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360231.114067:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360231.114098:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360231.114135:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360231.114180:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119552 00000100:00100000:3.0:1787360231.114187:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119552 00000100:00100000:3.0:1787360231.114270:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360231.114278:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596119552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360231.114494:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596119552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360231.114502:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360231.114540:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360231.114567:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360231.114600:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360231.114638:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360231.114665:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119680 00000100:00100000:0.0:1787360231.114676:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119680 00000100:00100000:0.0:1787360231.114707:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787360231.114713:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596119680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360231.114787:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:17202:x1874182596119680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360231.114794:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787360231.115464:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596119680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787360231.116592:0:18408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360231.124127:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360231.124164:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360231.124175:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360231.124188:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360231.289827:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787360231.867344:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360232.185462:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360222/real 1787360222] req@ffff99890415b800 x1874182596113920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360232 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360232.185489:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99890415b800 x1874182596113920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360232 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360232.185499:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360222/real 1787360222] req@ffff998a2eddfb80 x1874182596113664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360232 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360232.185510:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2eddfb80 x1874182596113664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360232 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360232.185526:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360232.185546:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1787360232.186175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.186191:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360232.186194:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.186196:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360232.186243:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.186246:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360232.186248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.186251:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787360232.186253:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360232.186258:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1787360232.186263:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360232.186268:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360232.186286:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904158e00 x1874182596120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360232.186332:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596119808:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360232.186438:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596120448:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186463:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360232.186483:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360232.186488:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596120192:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186514:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360232.186541:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596119936:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186575:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360232.186592:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360232.186603:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596120064:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186624:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360232.186652:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120448 00000100:00100000:1.0:1787360232.186658:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120448 00000100:00100000:1.0:1787360232.186692:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120064 00000100:00100000:1.0:1787360232.186695:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120064 00000100:00100000:1.0:1787360232.186714:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360232.186721:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186766:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596120448:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360232.186773:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360232.186788:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360232.186794:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596120064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186823:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596120064:12345-0@lo:400:kworker.0 Request processed in 29us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360232.186828:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360232.186843:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120192 00000100:00100000:1.0:1787360232.186846:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120192 00000100:00100000:1.0:1787360232.186866:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119936 00000100:00100000:1.0:1787360232.186869:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119936 00000100:00100000:1.0:1787360232.186880:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360232.186886:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186915:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596120192:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360232.186921:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360232.186932:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787360232.186937:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596119936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.186974:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596119936:12345-0@lo:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360232.186980:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787360232.187014:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890415aa00 x1874182596120064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360232.187026:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596120064:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.187037:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596119936:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.187067:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596120192:0@lo:400:kworker.0 00010000:00080000:1.0:1787360232.187076:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99890415ad80 x1874182596120448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360232.187083:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596120448:0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.187125:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596119808 00000100:00100000:1.0:1787360232.187128:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596119808 00000100:00100000:1.0:1787360232.187154:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360232.187160:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3659:x1874182596119808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360232.187194:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3659:x1874182596119808:12345-0@lo:400:kworker.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360232.187200:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360232.187258:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596119808:0@lo:400:kworker.0 00000100:00100000:0.0:1787360232.187453:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113920:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787360232.187461:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360232.187469:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360232.187472:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596113664:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1787360232.187492:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596120320:0@lo:8:kworker.0 00000400:00000100:0.0:1787360232.187518:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596120320 offset 0 length 520: 4 00000100:00080000:1.0:1787360232.188790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.188798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360232.188801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.188810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360232.188814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360232.188818:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787360232.188820:0:8:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360232.188826:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1787360232.188830:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360232.188835:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360232.188860:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904159500 x1874182596120576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360232.188925:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596120576:0@lo:8:kworker.0 00000400:00000100:0.0:1787360232.188961:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596120576 offset 0 length 520: 4 00010000:00010000:0.0:1787360232.891837:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360233.209633:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596120704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360233.209751:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360233.209808:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120704 00000100:00100000:0.0:1787360233.209816:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120704 00000100:00100000:0.0:1787360233.209877:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360233.209888:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596120704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360233.209931:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360233.209995:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3660:x1874182596120704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360233.210004:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360233.210089:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596120704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360233.211216:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596120832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787360233.211305:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360233.212117:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120832 00000100:00100000:1.0:1787360233.212133:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120832 00000100:00100000:1.0:1787360233.212197:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787360233.212221:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596120832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360233.212410:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787360233.212555:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596120832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 348us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360233.212563:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360233.212715:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596120832:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787360233.724243:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787360233.914325:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360234.237807:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360219/real 1787360219] req@ffff998a2eddea00 x1874182596111744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360234.237835:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2eddea00 x1874182596111744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360234.237845:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360219/real 1787360219] req@ffff998a2eddd880 x1874182596111872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360234 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360234.237857:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2eddd880 x1874182596111872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360234 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360234.237876:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360234.237899:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360234.237903:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111744:0@lo:8:kworker.0 00000100:00080000:3.0:1787360234.237908:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360234.237913:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787360234.237916:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596111872:0@lo:8:kworker.0 00000100:00080000:0.0:1787360234.238034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360234.238038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360234.238041:0:8:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360234.238045:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1787360234.238050:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360234.238056:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9989036e0000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360234.238075:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edddf80 x1874182596121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360234.238098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360234.238101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360234.238102:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360234.238105:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:0.0:1787360234.238107:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360234.238111:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a3c9c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360234.238123:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a2edde300 x1874182596121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360234.238150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360234.238154:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360234.238156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360234.238159:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360234.241176:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596120960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241291:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360234.241344:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596121728:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241376:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360234.241403:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360234.241410:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596121088:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241436:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360234.241469:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596121216:0@lo:8:kworker.0 00000400:00000100:3.0:1787360234.241491:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596121216 offset 0 length 520: 4 00000100:00100000:3.0:1787360234.241505:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596121344:0@lo:8:kworker.0 00000400:00000100:3.0:1787360234.241520:0:3657:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182596121344 offset 0 length 520: 4 00000100:00100000:3.0:1787360234.241545:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596121472:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241567:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360234.241586:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360234.241592:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596121600:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241613:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360234.241645:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121728 00000100:00100000:3.0:1787360234.241653:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121728 00000100:00100000:3.0:1787360234.241694:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121472 00000100:00100000:3.0:1787360234.241697:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121472 00000100:00100000:3.0:1787360234.241721:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360234.241729:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596121728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241778:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596121728:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360234.241785:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360234.241815:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360234.241820:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596121472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241854:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596121472:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360234.241860:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360234.241876:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121088 00000100:00100000:3.0:1787360234.241880:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121088 00000100:00100000:3.0:1787360234.241902:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121600 00000100:00100000:3.0:1787360234.241905:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121600 00000100:00100000:3.0:1787360234.241917:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787360234.241923:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596121088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.241955:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596121088:12345-0@lo:400:kworker.0 Request processed in 32us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360234.241961:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787360234.241972:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787360234.241978:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596121600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.242003:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596121600:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360234.242009:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787360234.242057:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596121600:0@lo:400:kworker.0 00010000:00080000:3.0:1787360234.242069:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a2eddc380 x1874182596121472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360234.242078:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596121472:0@lo:400:kworker.0 00000100:00100000:3.0:1787360234.242106:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596121088:0@lo:400:kworker.0 00010000:00080000:3.0:1787360234.242115:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff998a3feb0a80 x1874182596121728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360234.242129:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596121728:0@lo:400:kworker.0 00000100:00100000:0.0:1787360234.242199:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596120960 00000100:00100000:0.0:1787360234.242213:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596120960 00000100:00100000:0.0:1787360234.242269:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787360234.242276:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0323e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3658:x1874182596120960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360234.242312:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0323e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:3658:x1874182596120960:12345-0@lo:400:kworker.0 Request processed in 37us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360234.242318:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787360234.242400:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596120960:0@lo:400:kworker.0 00010000:00010000:3.0:1787360234.941594:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360235.328658:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360235.962450:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787360236.801703:0:18707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787360236.801707:0:18707:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787360236.801709:0:18707:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787360236.801814:0:18707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998a042ae800 00000020:01000004:2.0:1787360236.801830:0:18707:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787360236.801912:0:18707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787360236.801926:0:18707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff998a35948000) 00000020:00000080:2.0:1787360236.801942:0:18707:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787360236.851840:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787360236.855823:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787360236.856147:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787360236.856593:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787360236.857096:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787360236.857614:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787360236.858038:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1787360236.860389:0:18707:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787360236.860637:0:18707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787360236.860651:0:18707:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787360236.860673:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee7212d2 00000020:01000004:0.0:1787360236.860692:0:18707:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787360236.860716:0:18707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787360236.860720:0:18707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787360236.860726:0:18707:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787360236.860733:0:18707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787360236.860748:0:18707:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff998a34554d28) 00000020:00000080:0.0:1787360236.860760:0:18707:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1787360236.861921:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360236.862087:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787360236.862093:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787360236.870209:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787360236.870255:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787360236.871798:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787360236.871807:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787360236.874059:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360236.874481:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787360236.874489:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787360236.875223:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787360236.875382:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787360236.893799:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360236.894133:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787360236.894139:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787360236.895847:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787360236.895858:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787360236.896946:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787360236.896956:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787360236.899765:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360236.900066:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787360236.900072:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787360236.901195:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787360236.901204:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787360236.942515:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360236.942974:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787360236.942982:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787360236.944581:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787360236.944592:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787360236.945171:0:18707:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787360236.945208:0:18707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787360236.945214:0:18707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787360236.955710:0:18707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787360236.955759:0:18707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.111@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787360236.955764:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787360236.955766:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360236.955767:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360236.955769:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360236.955770:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360236.955771:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360236.955772:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360236.955774:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360236.955775:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360236.955779:0:18707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787360236.955781:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360236.955782:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360236.955783:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360236.955784:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360236.955785:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360236.955787:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360236.955788:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360236.955789:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360236.955790:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360236.955815:0:18707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787360236.955832:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596121856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360236.956051:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.956126:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e01a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360236.956164:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121856 00000100:00100000:1.0:1787360236.956171:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121856 00000100:00100000:1.0:1787360236.956400:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787360236.956410:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:18707:x1874182596121856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787360236.956438:0:17198:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787360236.956441:0:17198:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787360236.956445:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787360236.956760:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:18707:x1874182596121856:12345-0@lo:253:mount.lustre.0 Request processed in 349us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360236.956768:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360236.956847:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596121856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360236.956859:0:18707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787360236.956861:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360236.956863:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360236.956864:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360236.956865:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360236.956866:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360236.956868:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360236.956869:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360236.956871:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360236.956872:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360236.956887:0:18707:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998a042ae800 from lustre-OST0000 10000000:01000000:2.0:1787360236.956943:0:18707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787360236.956950:0:18707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360236.956958:0:18707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a35058000 local copy 00010000:00010000:2.0:1787360236.956967:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360236.957043:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596121984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360236.957086:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.957375:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e01d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360236.957517:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596121984 00000100:00100000:0.0:1787360236.957523:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596121984 00000100:00100000:0.0:1787360236.957548:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787360236.957555:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:18707:x1874182596121984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360236.957633:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:18707:x1874182596121984:12345-0@lo:501:mount.lustre.0 Request processed in 78us (546us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787360236.957640:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360236.957751:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596121984:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360236.957766:0:18707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787360236.957783:0:18707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787360236.957789:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360236.957797:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360236.957817:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998a042ae800 10000000:01000000:2.0:1787360236.957822:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360236.957827:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360236.957829:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360236.957845:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787360236.957848:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787360236.957868:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360236.957877:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360236.957907:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360236.957921:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360236.957948:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.957970:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e01d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360236.958101:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122112 00000100:00100000:0.0:1787360236.958106:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122112 00000100:00100000:0.0:1787360236.958126:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787360236.958132:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+18:18707:x1874182596122112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360236.958140:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360236.958151:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caee400/0x359a4e2aee7212e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7212e0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.958180:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caee400/0x359a4e2aee7212e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7212e0 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.958202:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caee400/0x359a4e2aee7212e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212e0 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.958211:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caee400, rc 0) 00000100:00100000:0.0:1787360236.958268:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122112:12345-0@lo:101:mount.lustre.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360236.958274:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360236.958480:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360236.958492:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360236.958501:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360236.959612:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787360236.960328:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360236.967606:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787360236.967657:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787360236.967668:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787360236.967746:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787360236.967763:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787360236.967775:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787360236.967802:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787360236.967807:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787360236.968005:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360236.968075:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.968180:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360236.969989:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122240 00000100:00100000:3.0:1787360236.970002:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122240 00000100:00100000:3.0:1787360236.970113:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787360236.970123:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360236.970351:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122240:12345-0@lo:501:mount.lustre.0 Request processed in 228us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360236.970359:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787360236.970594:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360236.970654:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360236.970712:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.970929:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360236.971091:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122368 00000100:00100000:1.0:1787360236.971098:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122368 00000100:00100000:1.0:1787360236.971127:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360236.971135:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360236.971996:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122368:12345-0@lo:503:mount.lustre.0 Request processed in 858us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360236.972012:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787360236.972205:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360236.973542:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360236.973648:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360236.973783:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360236.973820:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360236.973973:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122496 00000100:00100000:1.0:1787360236.973980:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122496 00000100:00100000:1.0:1787360236.974022:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787360236.974031:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360236.974588:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122496:12345-0@lo:502:mount.lustre.0 Request processed in 556us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360236.974597:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787360236.974754:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360236.974988:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787360236.975014:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787360236.975029:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787360236.975043:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787360236.975057:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787360236.975071:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787360236.975085:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787360236.975099:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787360236.975127:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787360236.975143:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787360236.975157:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787360236.975183:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787360236.975220:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360236.975296:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360236.975318:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360236.975482:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122624 00000100:00100000:1.0:1787360236.975488:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122624 00000100:00100000:1.0:1787360236.975529:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787360236.975536:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360236.975619:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122624:12345-0@lo:502:mount.lustre.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360236.975626:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787360236.975778:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360236.975823:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787360236.975832:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1787360236.976947:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787360236.976957:0:18724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787360236.976965:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360236.976967:0:18724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787360236.976973:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360236.976987:0:18724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff998a3dcbb370) 00000020:00000080:1.0:1787360236.977008:0:18724:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787360236.977014:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360236.977088:0:18724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a042ae800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787360236.977096:0:18724:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787360236.977103:0:18724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x359a4e2aee7212f5 00010000:00010000:1.0:1787360236.983059:0:18724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1787360236.983665:0:18724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787360236.986012:0:18724:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787360236.987463:0:18724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787360236.987474:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360236.987480:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987482:0:18724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787360236.987485:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787360236.987488:0:18724:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787360236.987489:0:18724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360236.987491:0:18724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360236.987492:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787360236.987494:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987495:0:18724:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787360236.987497:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360236.987500:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987501:0:18724:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787360236.987503:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787360236.987505:0:18724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787360236.987507:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360236.987509:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987510:0:18724:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787360236.987512:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360236.987514:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987515:0:18724:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787360236.987518:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787360236.987546:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360236.987549:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360236.987550:0:18724:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787360236.987553:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787360236.988788:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787360236.988827:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787360236.988854:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.988867:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a22697e00/0x359a4e2aee7212e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7212e7 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360236.988876:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a042ae800 from 1 10000000:01000000:0.0:1787360236.988879:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787360236.988922:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.988930:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360236.988940:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360236.988973:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360236.989029:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360236.989064:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903a32540 going to sleep for 11 seconds 00010000:00010000:3.0:1787360236.989984:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360236.990571:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122752 00000100:00100000:1.0:1787360236.990580:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122752 00000100:00100000:1.0:1787360236.990633:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787360236.990642:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596122752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360236.990656:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360236.990669:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7212fc expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360236.990699:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 20 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360236.990711:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 20 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360236.990720:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71600, rc 0) 00000100:00100000:1.0:1787360236.990779:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596122752:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360236.990785:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360236.991126:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360236.991144:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360236.991154:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360236.992215:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787360236.992539:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360236.992739:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787360236.992764:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787360236.992782:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787360236.992787:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787360236.992859:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360236.992976:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.993068:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e01e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360236.994995:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596122880 00000100:00100000:0.0:1787360236.995007:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596122880 00000100:00100000:0.0:1787360236.995064:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787360236.995074:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596122880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360236.995219:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596122880:12345-0@lo:501:mount.lustre.0 Request processed in 146us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360236.995242:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360236.995426:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596122880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360236.995467:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360236.995509:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.995529:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e01e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360236.995970:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123008 00000100:00100000:0.0:1787360236.995976:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123008 00000100:00100000:0.0:1787360236.996012:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787360236.996019:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360236.996105:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123008:12345-0@lo:503:mount.lustre.0 Request processed in 86us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360236.996112:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360236.996211:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787360236.997635:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360236.997797:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360236.998000:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360236.999014:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a28e010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360237.001041:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123136 00000100:00100000:0.0:1787360237.001053:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123136 00000100:00100000:0.0:1787360237.001112:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787360237.001123:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360237.001316:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123136:12345-0@lo:502:mount.lustre.0 Request processed in 194us (3314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.001324:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787360237.001557:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360237.002051:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787360237.002083:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787360237.002098:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787360237.002110:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787360237.002124:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787360237.002136:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787360237.002149:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787360237.002163:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787360237.002176:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787360237.002202:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787360237.002219:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787360237.002321:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.002459:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.002523:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a054bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360237.003152:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123264 00000100:00100000:2.0:1787360237.003159:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123264 00000100:00100000:2.0:1787360237.003399:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787360237.003409:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360237.003574:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123264:12345-0@lo:502:mount.lustre.0 Request processed in 166us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360237.003581:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787360237.003737:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360237.003797:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787360237.003807:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787360237.005012:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360237.005023:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005025:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787360237.005033:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a042ae800 00000020:00000080:1.0:1787360237.005036:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360237.005043:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360237.005045:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005047:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787360237.005049:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360237.005051:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005053:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787360237.005063:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998a042ae800 00000020:00000080:1.0:1787360237.005065:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360237.005124:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360237.005128:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005129:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787360237.005132:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360237.005134:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005136:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360237.005140:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a042ae800 00000020:00000080:1.0:1787360237.005142:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360237.005159:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360237.005161:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005162:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787360237.005165:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360237.005167:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005168:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787360237.005171:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998a042ae800 00000020:00000080:1.0:1787360237.005173:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787360237.005206:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360237.005210:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360237.005211:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787360237.005215:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787360237.010679:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787360237.010721:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360237.010778:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.010792:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360237.010868:0:18707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787360237.010871:0:18707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998a042ae800 10000000:01000000:3.0:1787360237.010874:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998a042ae800 10000000:01000000:3.0:1787360237.010878:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360237.010883:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998a042ae800 from 1 10000000:01000000:3.0:1787360237.010886:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787360237.011020:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.011029:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.011039:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.011061:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360237.011121:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.011163:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a203aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1787360237.011328:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123392 00000100:00100000:3.0:1787360237.011335:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123392 00000100:00100000:3.0:1787360237.011754:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360237.011765:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:18707:x1874182596123392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360237.011779:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360237.011795:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a067a8200/0x359a4e2aee721311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72130a expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.011819:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a067a8200/0x359a4e2aee721311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72130a expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.011960:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a067a8200/0x359a4e2aee721311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72130a expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.011969:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8200, rc 0) 00000100:00100000:3.0:1787360237.012013:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123392:12345-0@lo:101:mount.lustre.0 Request processed in 250us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.012020:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360237.012066:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360237.012079:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.012089:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360237.014983:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787360237.015260:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360237.016599:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787360237.016636:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787360237.016653:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787360237.016667:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787360237.017470:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787360237.017490:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787360237.017504:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787360237.017515:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787360237.017544:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787360237.017559:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787360237.017574:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787360237.017588:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787360237.017612:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787360237.017626:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787360237.017639:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787360237.017650:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787360237.017662:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787360237.017674:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787360237.018524:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787360237.018552:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787360237.018569:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787360237.018583:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787360237.018596:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787360237.018610:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787360237.018637:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787360237.018652:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787360237.018663:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787360237.019290:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787360237.019319:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787360237.019332:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787360237.019344:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787360237.019358:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787360237.019753:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787360237.019775:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787360237.019790:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787360237.019804:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787360237.019818:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787360237.020470:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787360237.020480:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787360237.020569:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360237.020631:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360237.021477:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123520 00000100:00100000:1.0:1787360237.021486:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123520 00000100:00100000:1.0:1787360237.021545:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787360237.021555:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360237.021702:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123520:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360237.021710:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787360237.022495:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360237.022523:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360237.022575:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360237.022623:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.022649:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360237.022996:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123648 00000100:00100000:1.0:1787360237.023002:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123648 00000100:00100000:1.0:1787360237.023050:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787360237.023059:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360237.023169:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123648:12345-0@lo:503:mount.lustre.0 Request processed in 111us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360237.023177:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787360237.023440:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360237.024631:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360237.025570:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.025635:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.025673:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123776 00000100:00100000:3.0:1787360237.026770:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123776 00000100:00100000:3.0:1787360237.026827:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787360237.026848:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.027167:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123776:12345-0@lo:502:mount.lustre.0 Request processed in 331us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.027175:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787360237.027260:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360237.027282:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360237.028731:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787360237.028771:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787360237.028785:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787360237.028799:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787360237.028812:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787360237.028826:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787360237.028840:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787360237.028854:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787360237.028867:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787360237.028881:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787360237.030204:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787360237.030263:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787360237.030276:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787360237.030287:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787360237.030300:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787360237.030312:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787360237.030343:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787360237.030359:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787360237.030965:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787360237.030988:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787360237.031000:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787360237.031013:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787360237.031028:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787360237.031044:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787360237.031060:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1787360237.031074:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1787360237.031087:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1787360237.031101:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1787360237.031116:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1787360237.031130:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1787360237.031143:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1787360237.031156:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1787360237.031185:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1787360237.031216:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1787360237.031248:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1787360237.031264:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1787360237.031278:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1787360237.031291:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1787360237.031305:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1787360237.031319:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1787360237.031333:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1787360237.031347:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1787360237.031360:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1787360237.033477:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1787360237.033530:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1787360237.033543:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1787360237.033554:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1787360237.033565:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1787360237.033641:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.033722:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.033766:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360237.033866:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596123904 00000100:00100000:1.0:1787360237.033873:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596123904 00000100:00100000:1.0:1787360237.034542:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787360237.034553:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360237.035125:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596123904:12345-0@lo:502:mount.lustre.0 Request processed in 572us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360237.035134:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787360237.036485:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596123904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360237.036687:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1787360237.036711:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1787360237.036741:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596124032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.036795:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.036829:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124032 00000100:00100000:3.0:1787360237.036846:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124032 00000100:00100000:3.0:1787360237.036881:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787360237.036888:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596124032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360237.037175:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596124032:12345-0@lo:502:mount.lustre.0 Request processed in 286us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.037182:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787360237.037256:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360237.037270:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596124032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360237.037305:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1787360237.037312:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787360237.040602:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787360237.040636:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff998a34550000) 00000020:00000080:0.0:1787360237.040661:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787360237.040772:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a042ae800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360237.040776:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a042ae800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787360237.040779:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a042ae800 3 00010000:00080000:0.0:1787360237.040815:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998a2f243800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00010000:0.0:1787360237.045787:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1787360237.046000:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787360237.046041:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360237.046053:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x359a4e2aee72131f 00000100:00080000:0.0:1787360237.046061:0:18733:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360237.046066:0:18733:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff998a2f243800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360237.046097:0:18733:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3feb3480 x1874182596124160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360237.046141:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596124160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360237.046214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360237.046289:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124160 00000100:00100000:0.0:1787360237.046296:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124160 00000100:00100000:0.0:1787360237.046322:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360237.046329:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1874182596124160:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360237.046353:0:17207:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1787360237.046390:0:17207:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x359a4e2aee721326 00000004:00100000:0.0:1787360237.046406:0:17207:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360237.046437:0:17207:0:(import.c:65:import_set_state_nolock()) ffff998a043a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360237.048536:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1874182596124160:12345-0@lo:38:llog_process_th.0 Request processed in 2197us (2313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.048549:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787360237.049543:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb3480 x1874182596124160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360237.049556:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360237.049564:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787360237.049572:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787360237.049577:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787360237.049580:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a2f243800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787360237.049587:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3657:1874182596124160:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787360237.050250:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787360237.052215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.052222:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.052238:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.052241:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.052272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.052275:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.052277:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.052280:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360237.053957:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596124288:0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.054023:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360237.054059:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360237.054065:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596124672:0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.054086:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360237.054120:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124288 00000100:00100000:0.0:1787360237.054127:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124288 00000100:00100000:0.0:1787360237.054172:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787360237.054182:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596124288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.054262:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596124288:12345-0@lo:400:kworker.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.054270:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787360237.054296:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124672 00000100:00100000:0.0:1787360237.054299:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124672 00000100:00100000:0.0:1787360237.054323:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360237.054330:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.054359:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596124672:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.054385:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787360237.054428:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890415ad80 x1874182596124672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360237.054442:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596124672:0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.054453:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596124288:0@lo:400:kworker.0 00000020:01000004:0.0:1787360237.054631:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787360237.054647:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff998a345519b8) 00000020:00000080:0.0:1787360237.054670:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:3.0:1787360237.055112:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596124416:0@lo:400:kworker.0 00000100:00100000:3.0:1787360237.055149:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.055172:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360237.055197:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596124544:0@lo:400:kworker.0 00000100:00100000:3.0:1787360237.055223:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.055265:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124544 00000100:00100000:3.0:1787360237.055269:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124544 00000100:00100000:3.0:1787360237.055326:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360237.055333:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596124544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360237.056537:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596124544:12345-0@lo:400:kworker.0 Request processed in 1200us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.056547:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360237.056594:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596124544:0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.057113:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124416 00000100:00100000:0.0:1787360237.057122:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124416 00000100:00100000:0.0:1787360237.057481:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787360237.057492:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360237.057552:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596124416:12345-0@lo:400:kworker.0 Request processed in 62us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.057559:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000004:1.0:1787360237.060786:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998a042ae800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787360237.060796:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998a042ae800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787360237.060799:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998a042ae800 3 00010000:00080000:1.0:1787360237.061014:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff998902a1d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.111@tcp at head 00010000:00080000:2.0:1787360237.061627:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890415a680 x1874182596124416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360237.061643:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596124416:0@lo:400:kworker.0 00010000:00010000:1.0:1787360237.064492:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787360237.064686:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787360237.064730:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787360237.064742:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x359a4e2aee721334 00000100:00080000:1.0:1787360237.064751:0:18733:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360237.064757:0:18733:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff998902a1d000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360237.064789:0:18733:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99890415b800 x1874182596124800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360237.064812:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787360237.064861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.064866:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.064869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.064871:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.064875:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.064877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360237.064880:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360237.064882:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360237.065139:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596124800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360237.065217:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360237.065289:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124800 00000100:00100000:0.0:1787360237.065295:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124800 00000100:00100000:0.0:1787360237.065324:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360237.065332:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596124800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360237.065354:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1787360237.065396:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x359a4e2aee72133b 00000004:00100000:0.0:1787360237.065410:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360237.065440:0:17206:0:(import.c:65:import_set_state_nolock()) ffff998a2f242800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360237.065497:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1874182596124800:12345-0@lo:38:llog_process_th.0 Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360237.065505:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787360237.065542:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890415b800 x1874182596124800/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360237.065553:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360237.065560:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787360237.065567:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787360237.065570:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787360237.065572:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902a1d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787360237.065577:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3657:1874182596124800:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787360237.068067:0:18733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787360237.068182:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787360237.068222:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787360237.068524:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.068536:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a8c00/0x359a4e2aee72130a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721311 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787360237.068586:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787360237.068588:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360237.068590:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360237.068591:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360237.068592:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360237.068593:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360237.068595:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360237.068597:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360237.068598:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360237.068602:0:18707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787360237.068604:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360237.068606:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360237.068607:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360237.068612:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360237.068613:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360237.068614:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360237.068615:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360237.068616:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360237.068617:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360237.068642:0:18707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787360237.068662:0:18707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596124928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360237.068733:0:18707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.068771:0:18707:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ee993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360237.070486:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596124928 00000100:00100000:1.0:1787360237.070499:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596124928 00000100:00100000:1.0:1787360237.070550:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787360237.070560:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:18707:x1874182596124928:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787360237.070586:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787360237.070599:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787360237.078000:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787360237.078015:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787360237.078107:0:17221:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787360237.078112:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787360237.078132:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078149:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078157:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721293 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078165:0:17221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078214:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078244:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 21 pid: 17197 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.078259:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596125056:0@lo:104: 00000100:00100000:3.0:1787360237.078326:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787360237.078371:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078380:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.078388:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596125184:0@lo:104: 00000100:00100000:3.0:1787360237.078413:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.078430:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a203aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1787360237.078456:0:17189:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787360237.078471:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125056 00000100:00100000:3.0:1787360237.078477:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125056 00000100:00100000:3.0:1787360237.078507:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125184 00000100:00100000:3.0:1787360237.078510:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125184 00000100:00100000:3.0:1787360237.078524:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360237.078531:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596125056:12345-0@lo:104: 00010000:00010000:3.0:1787360237.078543:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078590:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360237.078596:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596125056:12345-0@lo:104: Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.078602:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360237.078619:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360237.078626:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ffd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596125184:12345-0@lo:104: 00010000:00010000:3.0:1787360237.078633:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078675:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787360237.078680:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ffd5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596125184:12345-0@lo:104: Request processed in 55us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.078686:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360237.078739:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596125056:0@lo:104: 00000100:00100000:3.0:1787360237.078748:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596125184:0@lo:104: 00010000:00010000:3.0:1787360237.078764:0:17221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078780:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360237.078786:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078792:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8000 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360237.078796:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078803:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360237.078810:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360237.078816:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787360237.078847:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078854:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360237.078878:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078885:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a8000/0x359a4e2aee721293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72129a expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078898:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360237.078901:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078907:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caef600 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:3.0:1787360237.078910:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078917:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360237.078924:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360237.078929:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787360237.078942:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078948:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360237.078961:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078968:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caef600/0x359a4e2aee721285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72128c expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.078989:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360237.078990:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360237.078992:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360237.078997:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360237.079003:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360237.079013:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596125312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360237.079037:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.079058:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596125440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360237.079075:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360237.079117:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125312 00000100:00100000:3.0:1787360237.079121:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125312 00010000:00010000:3.0:1787360237.079138:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 22 pid: 17197 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.079155:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125440 00000100:00100000:3.0:1787360237.079158:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125440 00010000:00010000:3.0:1787360237.079167:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 23 pid: 17198 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.079179:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360237.079185:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:3658:x1874182596125312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360237.079353:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360237.079357:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 23 pid: 17197 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079367:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 23 pid: 17197 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079390:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71e00/0x359a4e2aee72129a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721293 expref: 23 pid: 17197 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079402:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360237.079432:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:3658:x1874182596125312:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.079438:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360237.079451:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360237.079457:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a227f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3660:x1874182596125440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360237.079464:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360237.079468:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079476:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079485:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a22696000/0x359a4e2aee72128c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721285 expref: 21 pid: 17198 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079496:0:17192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079504:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787360237.079515:0:17192:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011265149s 00010000:00010000:3.0:1787360237.079519:0:17192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079536:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079543:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079549:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079553:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360237.079557:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079564:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079576:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079586:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360237.079612:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a227f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:3660:x1874182596125440:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.079618:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360237.079669:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596125312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360237.079687:0:17221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079694:0:17221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360237.079710:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a067a9a00/0x359a4e2aee721342 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360237.079738:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596125440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360237.081715:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:18707:x1874182596124928:12345-0@lo:253:mount.lustre.0 Request processed in 11150us (12974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360237.081728:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787360237.081784:0:18707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:18707:1874182596124928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787360237.081799:0:18707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787360237.081802:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787360237.081803:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360237.081804:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360237.081805:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360237.081807:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360237.081808:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360237.081809:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360237.081811:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360237.081813:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787360237.081825:0:18707:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787360237.084209:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787360237.093088:0:18707:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787360237.093096:0:18707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787360237.093131:0:18707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787360237.093179:0:18707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787360237.093209:0:18707:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787360237.094466:0:18707:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787360237.096338:0:18707:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787360237.098624:0:18707:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360238.009356:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787360238.054091:0:18787:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360238.054861:0:18787:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787360238.329643:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360238.329667:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596125568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360238.329734:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360238.329846:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125568 00000100:00100000:1.0:1787360238.329854:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125568 00000100:00100000:1.0:1787360238.329899:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787360238.329909:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596125568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787360238.329940:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787360238.329988:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596125568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360238.329994:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360238.330095:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596125568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360238.330677:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360238.330689:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596125696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360238.330723:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360238.330786:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125696 00000100:00100000:3.0:1787360238.330791:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125696 00000100:00100000:3.0:1787360238.330826:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360238.330834:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596125696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360238.331265:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360238.331309:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596125696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 475us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360238.331315:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787360238.331358:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596125696:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1787360238.468052:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787360238.468059:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9989029fe800 from 9 10000000:01000000:1.0:1787360238.468063:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787360238.468106:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360238.468117:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360238.468128:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360238.468151:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596125824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360238.468427:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360238.468915:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125824 00000100:00100000:3.0:1787360238.468924:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125824 00000100:00100000:3.0:1787360238.468984:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787360238.468993:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+19:17202:x1874182596125824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360238.469007:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360238.469021:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721349 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.469055:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721349 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.469065:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721349 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.469074:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8000, rc 0) 00000100:00100000:3.0:1787360238.469112:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:17202:x1874182596125824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360238.469118:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787360238.469585:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a31383840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360238.469611:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596125824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360238.469628:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360238.469637:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360238.469712:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596125952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787360238.469748:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360238.469812:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a31383840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360238.473563:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596125952 00000100:00100000:3.0:1787360238.473576:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596125952 00000100:00100000:3.0:1787360238.473641:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360238.473652:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:17202:x1874182596125952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787360238.473674:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787360238.473691:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787360238.473694:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787360238.473811:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:17202:x1874182596125952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (4061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360238.473826:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787360238.473876:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596125952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360238.473941:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360238.473951:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.473960:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360238.473970:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787360238.473972:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a3d61f800 from 9 10000000:01000000:3.0:1787360238.473974:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787360238.474000:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.474007:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.474015:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360238.474034:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596126080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360238.474064:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360238.474092:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a07f9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360238.474105:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126080 00000100:00100000:3.0:1787360238.474109:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126080 00000100:00100000:3.0:1787360238.474134:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787360238.474139:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:17202:x1874182596126080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360238.474154:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360238.474165:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721357 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.475345:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721357 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.475356:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721357 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.475365:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a067a8a00, rc 0) 00000100:00100000:3.0:1787360238.475415:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596126080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1274us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360238.475423:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787360238.476043:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596126080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360238.476064:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.476074:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360238.476143:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596126208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360238.476207:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360238.476265:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a07f9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360238.476284:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126208 00000100:00100000:3.0:1787360238.476289:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126208 00000100:00100000:3.0:1787360238.476326:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787360238.476334:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596126208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787360238.476358:0:17197:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787360238.476371:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787360238.476374:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1787360238.476448:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596126208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360238.476455:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787360238.476500:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902914700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596126208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360238.476550:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360238.476557:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360238.476565:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360239.035040:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360240.060667:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360241.082454:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360241.531944:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787360242.105456:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360242.426579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360242.426585:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360242.426588:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360242.426591:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360242.426603:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596126336:0@lo:400:kworker.0 00000100:00080000:1.0:1787360242.426609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360242.426614:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360242.426616:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360242.426619:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787360242.426682:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360242.426704:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596126720:0@lo:400:kworker.0 00000100:00100000:3.0:1787360242.426742:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596126848:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.426747:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360242.426780:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360242.426791:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596126464:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.426820:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360242.426841:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126848 00000100:00100000:1.0:1787360242.426843:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596126976:0@lo:400:kworker.0 00000100:00100000:3.0:1787360242.426850:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126848 00000100:00100000:1.0:1787360242.426871:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360242.426890:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787360242.426895:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596126592:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.426915:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360242.426932:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596127104:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.426973:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360242.426997:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126336 00000100:00100000:1.0:1787360242.427001:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126336 00000100:00100000:3.0:1787360242.427030:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126976 00000100:00100000:3.0:1787360242.427035:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126976 00000100:00100000:1.0:1787360242.427039:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787360242.427051:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3659:x1874182596126336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360242.427074:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126592 00000100:00100000:3.0:1787360242.427079:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126592 00000100:00100000:3.0:1787360242.427094:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127104 00000100:00100000:3.0:1787360242.427097:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127104 00000100:00100000:1.0:1787360242.427106:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3659:x1874182596126336:12345-0@lo:400:kworker.0 Request processed in 57us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360242.427115:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787360242.427130:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360242.427138:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596126848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427153:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126720 00000100:00100000:1.0:1787360242.427174:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126720 00000100:00100000:3.0:1787360242.427189:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596126848:12345-0@lo:400:kworker.0 Request processed in 52us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360242.427196:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360242.427206:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596126464 00000100:00100000:1.0:1787360242.427211:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596126464 00000100:00100000:3.0:1787360242.427214:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360242.427222:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596126976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427259:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360242.427268:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596126720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360242.427293:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596126976:12345-0@lo:400:kworker.0 Request processed in 72us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360242.427301:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360242.427315:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360242.427322:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596126720:12345-0@lo:400:kworker.0 Request processed in 54us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360242.427325:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596126592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427336:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787360242.427359:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360242.427361:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596126592:12345-0@lo:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360242.427370:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360242.427372:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360242.427386:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787360242.427394:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596127104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427414:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596126464:12345-0@lo:400:kworker.0 Request processed in 46us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360242.427422:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360242.427428:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596127104:12345-0@lo:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360242.427435:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360242.427488:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596126720:0@lo:400:kworker.0 00010000:00080000:1.0:1787360242.427523:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890415b800 x1874182596126848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360242.427533:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596126848:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427550:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596126336:0@lo:400:kworker.0 00010000:00080000:1.0:1787360242.427575:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998904158a80 x1874182596126592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360242.427584:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596126592:0@lo:400:kworker.0 00010000:00080000:1.0:1787360242.427593:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510ce00 x1874182596127104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360242.427601:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596127104:0@lo:400:kworker.0 00000100:00100000:1.0:1787360242.427609:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596126464:0@lo:400:kworker.0 00010000:00080000:1.0:1787360242.427617:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890415bb80 x1874182596126976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360242.427625:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596126976:0@lo:400:kworker.0 00000100:00080000:1.0:1787360242.427672:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360242.427675:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787360243.129717:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360243.450490:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360243.450510:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596127232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787360243.450576:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360243.450617:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127232 00000100:00100000:2.0:1787360243.450629:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127232 00000100:00100000:2.0:1787360243.450670:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360243.450679:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596127232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360243.450711:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360243.450756:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596127232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360243.450762:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787360243.450806:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596127232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360243.453609:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360243.453631:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596127360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360243.453691:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360243.453731:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127360 00000100:00100000:1.0:1787360243.453738:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127360 00000100:00100000:1.0:1787360243.453777:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787360243.453784:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596127360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360243.453965:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360243.454020:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596127360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 235us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360243.454038:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787360243.454143:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596127360:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787360243.795787:0:19077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787360244.153967:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787360244.846741:0:19129:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787360244.847142:0:19129:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787360245.180832:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360245.561875:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1787360245.710971:0:19179:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360245.711441:0:19179:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360246.202363:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360247.227802:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360247.289362:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360232/real 1787360232] req@ffff998904159500 x1874182596120576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.289396:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904159500 x1874182596120576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.289428:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360232/real 1787360232] req@ffff998904158e00 x1874182596120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.289448:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998904158e00 x1874182596120320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360247.289468:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360247.289492:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360247.289496:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596120576:0@lo:8:kworker.0 00000100:00080000:0.0:1787360247.289501:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360247.289506:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360247.289510:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596120320:0@lo:8:kworker.0 00000100:00080000:2.0:1787360247.289881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360247.289886:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360247.289889:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360247.289891:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360247.289925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360247.289928:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787360247.289930:0:36:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360247.289935:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1787360247.289940:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787360247.289946:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff998902614000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360247.289963:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903948e00 x1874182596128000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360247.289975:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360247.289984:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787360247.289985:0:36:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360247.289989:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1787360247.289991:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787360247.289994:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360247.290009:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998903948000 x1874182596128128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360247.290051:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596127872:0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360247.290180:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787360247.290187:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596127744:0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290213:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360247.290260:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596128512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290284:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360247.290310:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127872 00000100:00100000:2.0:1787360247.290316:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127872 00000100:00100000:2.0:1787360247.290358:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360247.290366:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596127872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290414:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596127872:12345-0@lo:400:kworker.0 Request processed in 48us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.290420:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787360247.290527:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596127616:0@lo:400:kworker.0 00000100:00100000:3.0:1787360247.290559:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360247.290598:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127744 00000100:00100000:2.0:1787360247.290603:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127744 00000100:00100000:2.0:1787360247.290626:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128512 00000100:00100000:2.0:1787360247.290629:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128512 00000100:00100000:2.0:1787360247.290655:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360247.290662:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596127744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290703:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596127744:12345-0@lo:400:kworker.0 Request processed in 41us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.290709:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360247.290721:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360247.290726:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596128512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290753:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596128512:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.290758:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787360247.290778:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787360247.290800:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998903949f80 x1874182596127744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360247.290811:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596127744:0@lo:400:kworker.0 00010000:00080000:2.0:1787360247.290821:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37846a00 x1874182596128512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360247.290829:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596128512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.290838:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596127872:0@lo:400:kworker.0 00000100:00100000:1.0:1787360247.291676:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596127488:0@lo:400:kworker.0 00000100:00100000:1.0:1787360247.291724:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360247.291766:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596128256:0@lo:400:kworker.0 00000100:00100000:1.0:1787360247.291789:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360247.291829:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128256 00000100:00100000:1.0:1787360247.291834:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128256 00000100:00100000:1.0:1787360247.291865:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360247.291872:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596128256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360247.291912:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596128256:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360247.291918:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787360247.291951:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99890394b480 x1874182596128256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360247.291962:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596128256:0@lo:400:kworker.0 00000100:00100000:0.0:1787360247.292159:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596128000:0@lo:8:kworker.0 00000100:00100000:0.0:1787360247.292190:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360247.292219:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596128128:0@lo:8:kworker.0 00000100:00100000:0.0:1787360247.292260:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360247.292384:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128000 00000100:00100000:1.0:1787360247.292389:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128000 00000100:00100000:1.0:1787360247.292404:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128128 00000100:00100000:1.0:1787360247.292406:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128128 00000100:00100000:1.0:1787360247.292415:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787360247.292420:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1874182596128000:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787360247.292460:0:18711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 525 last 0 00000100:00100000:0.0:1787360247.292466:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127616 00000020:00000080:1.0:1787360247.292488:0:18711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee721365 00002000:00100000:1.0:1787360247.292502:0:18711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff998902a19800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787360247.292506:0:18711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787360247.292509:0:18711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787360247.292524:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596128384:0@lo:400:kworker.0 00000100:00100000:3.0:1787360247.292556:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360247.292591:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128384 00000100:00100000:3.0:1787360247.292595:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128384 00000100:00100000:3.0:1787360247.292624:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787360247.292630:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596128384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360247.292662:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1874182596128384:12345-0@lo:400:kworker.0 Request processed in 33us (105us total) trans 0 rc 0/0 00002000:00080000:1.0:1787360247.292672:0:18711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787360247.292696:0:18711:0:(import.c:65:import_set_state_nolock()) ffff998902a18800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360247.292735:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596128000:12345-0@lo:8:kworker.0 Request processed in 312us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360247.292742:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360247.292753:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127616 00000100:00100000:1.0:1787360247.292755:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360247.292759:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1874182596128128:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787360247.292769:0:18711:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787360247.292780:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787360247.292785:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360247.292817:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596127616:12345-0@lo:400:kworker.0 Request processed in 32us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360247.292823:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787360247.292852:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998903948e00 x1874182596128000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.292872:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360247.292878:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787360247.292886:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787360247.292890:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787360247.292893:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998902614000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787360247.292905:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787360247.292910:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596128000:0@lo:8:kworker.0 00000100:00080000:0.0:1787360247.292947:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1787360247.292988:0:17949:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787360247.293005:0:17949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596128768:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787360247.293149:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1787360247.293170:0:17947:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787360247.293254:0:17947:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 525540027394ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787360247.293261:0:17947:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787360247.293296:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596127616:0@lo:400:kworker.0 00010000:00080000:3.0:1787360247.293308:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37846d80 x1874182596128384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360247.293316:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3661:1874182596128384:0@lo:400:kworker.0 00000100:00100000:3.0:1787360247.293342:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360247.293350:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596128640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360247.293604:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360247.293617:0:17949:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360247.293872:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360247.294004:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596127488 00000100:00100000:2.0:1787360247.294010:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596127488 00000100:00100000:2.0:1787360247.294057:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787360247.294065:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3660:x1874182596127488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360247.294113:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3660:x1874182596127488:12345-0@lo:400:kworker.0 Request processed in 50us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.294119:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787360247.294164:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787360247.294179:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787360247.294194:0:18714:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787360247.294202:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128768 00000100:00100000:2.0:1787360247.294205:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128768 00000100:00100000:2.0:1787360247.294263:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128640 00000100:00100000:2.0:1787360247.294267:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128640 00000100:00100000:2.0:1787360247.294290:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360247.294296:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596128640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360247.294314:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787360247.294349:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596128640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.294355:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787360247.294378:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360247.294480:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360247.294487:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17949:x1874182596128768:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:3.0:1787360247.294560:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb1880 x1874182596128640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360247.294578:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596128640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360247.294617:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596127488:0@lo:400:kworker.0 00000004:00080000:0.0:1787360247.298918:0:17939:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787360247.305951:0:19239:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787360247.305960:0:19239:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787360247.306051:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17949:x1874182596128768:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11560us (12442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.306062:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787360247.306263:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb2a00 x1874182596128768/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787360263 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.306277:0:17949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596128768:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787360247.306290:0:17949:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787360247.306326:0:17949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596128896:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787360247.306360:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360247.306383:0:17949:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360247.306567:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596128896 00000100:00100000:2.0:1787360247.306574:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596128896 00000100:00100000:2.0:1787360247.306615:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360247.306624:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1874182596128896:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787360247.306647:0:18714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787360247.306723:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1874182596128896:12345-0@lo:5:osp-pre-0-1.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.306729:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787360247.307371:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb2a00 x1874182596128896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360263 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.308781:0:17949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596128896:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787360247.308799:0:17949:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1787360247.308862:0:17949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596129024:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787360247.308913:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360247.308946:0:17949:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360247.308993:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129024 00000100:00100000:2.0:1787360247.309006:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129024 00000100:00100000:2.0:1787360247.309068:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360247.309077:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17949:x1874182596129024:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787360247.309116:0:19239:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787360247.310728:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3657:x1874182596128128:12345-0@lo:8:kworker.0 Request processed in 17961us (18462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787360247.310740:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787360247.311089:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360247.311096:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360247.311100:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596128128:0@lo:8:kworker.0 00000001:00080000:1.0:1787360247.347315:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787360247.347330:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787360247.347888:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17949:x1874182596129024:12345-0@lo:5:osp-pre-0-1.0 Request processed in 38808us (38970us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787360247.347900:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787360247.348122:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb2a00 x1874182596129024/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.348144:0:17949:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787360247.348151:0:17949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17949:1874182596129024:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787360247.348166:0:17949:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787360247.348214:0:17949:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1874182596129152:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787360247.348567:0:17949:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360247.348594:0:17949:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360247.348628:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129152 00000100:00100000:2.0:1787360247.348634:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129152 00000100:00100000:2.0:1787360247.348685:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360247.348694:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1874182596129152:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787360247.348747:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1874182596129152:12345-0@lo:900:osp-pre-0-1.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360247.348754:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787360247.348773:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb2a00 x1874182596129152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360247.348794:0:17949:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1874182596129152:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787360248.252150:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360248.570262:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596129280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360248.570339:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360248.570372:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129280 00000100:00100000:2.0:1787360248.570380:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129280 00000100:00100000:2.0:1787360248.570434:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787360248.570444:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596129280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787360248.570476:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787360248.570551:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596129280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360248.570558:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360248.570635:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596129280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360248.571450:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360248.571464:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596129408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360248.571502:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360248.571532:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129408 00000100:00100000:2.0:1787360248.571537:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129408 00000100:00100000:2.0:1787360248.571576:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360248.571584:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596129408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360248.571607:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360248.571677:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596129408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360248.571683:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787360248.571811:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596129408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787360249.275314:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360250.299305:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360251.322366:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360251.770917:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787360252.350891:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360252.665475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360252.665482:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360252.665485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360252.665489:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360252.665524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360252.665528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787360252.665531:0:36:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787360252.665540:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1787360252.665546:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787360252.665552:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360252.665575:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a37847b80 x1874182596130176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360252.665629:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596129792:0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.665726:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666142:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596129536:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.666184:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666249:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596130048:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.666291:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666334:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787360252.666351:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596129664:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.666394:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666415:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596130304:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.666437:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666468:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596130176:0@lo:8:kworker.0 00000100:00100000:0.0:1787360252.666509:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.666543:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129536 00000100:00100000:0.0:1787360252.666550:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129536 00000100:00100000:0.0:1787360252.666595:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360252.666604:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3658:x1874182596129536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.666659:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:3658:x1874182596129536:12345-0@lo:400:kworker.0 Request processed in 56us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.666665:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360252.666697:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129664 00000100:00100000:0.0:1787360252.666701:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129664 00000100:00100000:0.0:1787360252.666726:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787360252.666732:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596129664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.667011:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596130432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.667046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360252.667069:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787360252.667076:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596129920:0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.667097:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360252.667126:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596130560:0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.667157:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360252.667206:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129792 00000100:00100000:2.0:1787360252.667210:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129792 00000100:00100000:2.0:1787360252.667247:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130304 00000100:00100000:2.0:1787360252.667251:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130304 00000100:00100000:3.0:1787360252.667455:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130048 00000100:00100000:3.0:1787360252.667459:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130048 00000100:00100000:3.0:1787360252.667497:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130176 00000100:00100000:3.0:1787360252.667508:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130176 00000100:00100000:3.0:1787360252.667532:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360252.667540:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596130048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360252.667581:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596130048:12345-0@lo:400:kworker.0 Request processed in 43us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360252.667587:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360252.667604:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787360252.667609:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596130176:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787360252.667627:0:18713:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787360252.668600:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130432 00000100:00100000:2.0:1787360252.668609:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130432 00000100:00100000:2.0:1787360252.668636:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130560 00000100:00100000:2.0:1787360252.668639:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130560 00000100:00100000:2.0:1787360252.668656:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787360252.668665:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.668733:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596129792:12345-0@lo:400:kworker.0 Request processed in 68us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360252.668740:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787360252.668756:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360252.668763:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596130304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.668909:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596129664:12345-0@lo:400:kworker.0 Request processed in 2175us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.668917:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787360252.668935:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596129920 00000100:00100000:0.0:1787360252.668938:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596129920 00000100:00100000:0.0:1787360252.668956:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787360252.668962:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596129920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.668991:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596129920:12345-0@lo:400:kworker.0 Request processed in 29us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.669006:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787360252.669032:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360252.669040:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596130432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.669072:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596130432:12345-0@lo:400:kworker.0 Request processed in 34us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.669078:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360252.669089:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360252.669095:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596130560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.669136:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596130560:12345-0@lo:400:kworker.0 Request processed in 41us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.669142:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360252.669193:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596129664:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.669205:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596129536:0@lo:400:kworker.0 00010000:00080000:0.0:1787360252.669217:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37846300 x1874182596130048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360252.669247:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596130048:0@lo:400:kworker.0 00000100:00100000:2.0:1787360252.670058:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596130304:12345-0@lo:400:kworker.0 Request processed in 1293us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360252.670068:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360252.670133:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596129920:0@lo:400:kworker.0 00010000:00080000:2.0:1787360252.670148:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37845880 x1874182596130560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360252.670159:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596130560:0@lo:400:kworker.0 00010000:00080000:2.0:1787360252.670171:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37846680 x1874182596129792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360252.670179:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596129792:0@lo:400:kworker.0 00010000:00080000:2.0:1787360252.670205:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37844a80 x1874182596130432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360252.670213:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596130432:0@lo:400:kworker.0 00010000:00080000:0.0:1787360252.670484:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37844e00 x1874182596130304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360252.670493:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596130304:0@lo:400:kworker.0 00000100:00100000:0.0:1787360252.673498:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360252.673519:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596130688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360252.673584:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360252.673646:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130688 00000100:00100000:0.0:1787360252.673652:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130688 00000100:00100000:0.0:1787360252.673695:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360252.673703:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596130688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360252.673728:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360252.674066:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596130688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 362us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360252.674074:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787360252.674125:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3feb3b80 x1874182596130688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360252.674141:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596130688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360252.674259:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360252.674273:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360252.674276:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360252.693060:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596130176:12345-0@lo:8:kworker.0 Request processed in 25441us (26542us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787360252.693075:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787360252.693144:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360252.693149:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360252.693153:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596130176:0@lo:8:kworker.0 00000020:01000004:2.0:1787360252.919216:0:19525:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787360252.919220:0:19525:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787360252.919221:0:19525:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787360252.919390:0:19525:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff998903b0b000 00000020:01000004:2.0:1787360252.919407:0:19525:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787360252.919422:0:19525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787360252.919434:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff998a3594b370) 00000020:00000080:2.0:1787360252.919452:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787360252.967300:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787360252.971727:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787360252.972317:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787360252.972516:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787360252.973207:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787360252.973528:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787360252.973876:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787360252.976375:0:19525:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787360252.976595:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787360252.976609:0:19525:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787360252.976625:0:19525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee721373 00000020:01000004:3.0:1787360252.976637:0:19525:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787360252.976659:0:19525:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787360252.976662:0:19525:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787360252.976668:0:19525:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787360252.976698:0:19525:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787360252.976701:0:19525:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787360252.996945:0:19525:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787360252.996983:0:19525:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.111@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787360252.996998:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787360252.997000:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360252.997002:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360252.997003:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360252.997004:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360252.997006:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360252.997008:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360252.997010:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360252.997011:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787360252.997015:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787360252.997018:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787360252.997019:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360252.997020:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360252.997021:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360252.997022:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360252.997023:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360252.997024:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360252.997025:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360252.997026:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787360252.997051:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787360252.997068:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596130816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787360252.997154:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360252.997268:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360252.997879:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130816 00000100:00100000:3.0:1787360252.997887:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130816 00000100:00100000:3.0:1787360252.997977:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787360252.997987:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:19525:x1874182596130816:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360252.998037:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787360252.998041:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787360252.998044:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787360252.998560:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:19525:x1874182596130816:12345-0@lo:253:mount.lustre.0 Request processed in 573us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360252.998568:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787360252.998643:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596130816:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787360252.998656:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787360252.998659:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787360252.998660:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360252.998661:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360252.998662:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360252.998663:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360252.998665:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360252.998672:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360252.998674:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360252.998675:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787360252.998693:0:19525:0:(tgt_mount.c:101:server_register_mount()) register mount ffff998903b0b000 from lustre-OST0001 10000000:01000000:1.0:1787360252.998720:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787360252.998723:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787360252.998731:0:19525:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff998a35058000 local copy 00010000:00010000:1.0:1787360252.998740:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360252.998830:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596130944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360252.998860:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360252.999202:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360252.999313:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596130944 00000100:00100000:0.0:1787360252.999320:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596130944 00000100:00100000:0.0:1787360252.999350:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787360252.999358:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:19525:x1874182596130944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360252.999433:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:19525:x1874182596130944:12345-0@lo:501:mount.lustre.0 Request processed in 75us (572us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787360252.999441:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787360252.999503:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596130944:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787360252.999516:0:19525:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787360252.999533:0:19525:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787360252.999539:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360252.999548:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefa00/0x359a4e2aee72108d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721094 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360252.999570:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff998903b0b000 10000000:01000000:1.0:1787360252.999575:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787360252.999580:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787360252.999583:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787360252.999586:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787360252.999589:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787360252.999610:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360252.999640:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360252.999650:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360252.999663:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360252.999701:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360252.999727:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360253.000080:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131072 00000100:00100000:0.0:1787360253.000085:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131072 00000100:00100000:0.0:1787360253.000119:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787360253.000125:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:19525:x1874182596131072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360253.000134:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360253.000146:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caef400/0x359a4e2aee721381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee72137a expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.000164:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef400/0x359a4e2aee721381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee72137a expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.000182:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caef400/0x359a4e2aee721381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee72137a expref: 22 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.000191:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef400, rc 0) 00000100:00100000:0.0:1787360253.000257:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131072:12345-0@lo:101:mount.lustre.0 Request processed in 132us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.000263:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787360253.000336:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360253.000348:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.000356:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360253.001341:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787360253.002081:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360253.004220:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787360253.004289:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787360253.004307:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787360253.004323:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787360253.004343:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787360253.004356:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787360253.004379:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787360253.004385:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787360253.004487:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360253.004550:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.004593:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.005101:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131200 00000100:00100000:2.0:1787360253.005121:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131200 00000100:00100000:2.0:1787360253.005173:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787360253.005186:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360253.005352:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131200:12345-0@lo:501:mount.lustre.0 Request processed in 170us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.005360:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787360253.005533:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360253.005571:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360253.005613:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.005643:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.005699:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131328 00000100:00100000:2.0:1787360253.005703:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131328 00000100:00100000:2.0:1787360253.005734:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787360253.005742:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360253.006679:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131328:12345-0@lo:503:mount.lustre.0 Request processed in 933us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.006689:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787360253.006792:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787360253.007202:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787360253.007293:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360253.007333:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.007367:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.007476:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131456 00000100:00100000:2.0:1787360253.007481:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131456 00000100:00100000:2.0:1787360253.007523:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787360253.007531:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360253.007884:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131456:12345-0@lo:502:mount.lustre.0 Request processed in 353us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.007892:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787360253.007973:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360253.008142:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787360253.008167:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787360253.008182:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787360253.008201:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787360253.008217:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787360253.008248:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787360253.008262:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787360253.008276:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787360253.008300:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787360253.008323:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360253.008363:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.008382:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.008432:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131584 00000100:00100000:2.0:1787360253.008437:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131584 00000100:00100000:2.0:1787360253.008507:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787360253.008515:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360253.008594:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131584:12345-0@lo:502:mount.lustre.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.008602:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360253.008659:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360253.008693:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787360253.008702:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787360253.009422:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787360253.009430:0:19529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787360253.009436:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360253.009437:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787360253.009443:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787360253.009468:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff998902ba99b8) 00000020:00000080:1.0:1787360253.009490:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787360253.009497:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787360253.009558:0:19529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998903b0b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787360253.009566:0:19529:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787360253.009572:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x359a4e2aee72138f 00010000:00010000:1.0:1787360253.014708:0:19529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787360253.015160:0:19529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787360253.016551:0:19529:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787360253.021401:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787360253.021414:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360253.021420:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360253.021422:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787360253.021426:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360253.021430:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360253.021432:0:19529:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787360253.021434:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787360253.021437:0:19529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787360253.021439:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360253.021441:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360253.021442:0:19529:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787360253.021444:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360253.021446:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360253.021447:0:19529:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787360253.021450:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787360253.021479:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360253.021482:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360253.021484:0:19529:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787360253.021488:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787360253.021643:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787360253.021672:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787360253.021696:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360253.021707:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998903b71c00/0x359a4e2aee72137a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721381 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360253.021715:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998903b0b000 from 1 10000000:01000000:3.0:1787360253.021718:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360253.021763:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360253.021771:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360253.021790:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360253.021813:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360253.021880:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.021921:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a18cfef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.022125:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131712 00000100:00100000:1.0:1787360253.022133:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131712 00000100:00100000:1.0:1787360253.022210:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787360253.022259:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596131712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360253.022286:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360253.022299:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721396 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.022350:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721396 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.022361:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721396 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.022369:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:1.0:1787360253.022409:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596131712:12345-0@lo:101:mount.lustre.0 Request processed in 191us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.022426:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787360253.022565:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360253.022579:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360253.022588:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360253.023546:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787360253.024080:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360253.024611:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787360253.024658:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787360253.024679:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787360253.024684:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787360253.025349:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360253.025441:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.027691:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780900 going to sleep for 11 seconds 00000100:00100000:0.0:1787360253.027964:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131840 00000100:00100000:0.0:1787360253.027972:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131840 00000100:00100000:0.0:1787360253.028059:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787360253.028070:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596131840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360253.028303:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596131840:12345-0@lo:501:mount.lustre.0 Request processed in 234us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.028311:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787360253.028516:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360253.028562:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360253.028606:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.028635:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.028686:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596131968 00000100:00100000:1.0:1787360253.028691:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596131968 00000100:00100000:1.0:1787360253.028765:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787360253.028773:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596131968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360253.028875:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596131968:12345-0@lo:503:mount.lustre.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.028882:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787360253.029012:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596131968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360253.029437:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360253.029499:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360253.029535:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.029554:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.029636:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132096 00000100:00100000:1.0:1787360253.029640:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132096 00000100:00100000:1.0:1787360253.029661:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787360253.029667:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596132096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360253.029821:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596132096:12345-0@lo:502:mount.lustre.0 Request processed in 153us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.029828:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360253.029895:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360253.030064:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787360253.030092:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787360253.030123:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787360253.030140:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787360253.030154:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787360253.030167:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787360253.030180:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787360253.030191:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787360253.030216:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787360253.030861:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787360253.030885:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787360253.030918:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360253.030969:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.031000:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780900 going to sleep for 11 seconds 00000100:00100000:0.0:1787360253.031070:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132224 00000100:00100000:0.0:1787360253.031076:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132224 00000100:00100000:0.0:1787360253.031117:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787360253.031125:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596132224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360253.031246:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596132224:12345-0@lo:502:mount.lustre.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.031253:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360253.031386:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360253.031428:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787360253.031437:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787360253.032591:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360253.032600:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.032603:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787360253.032609:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998903b0b000 00000020:00000080:3.0:1787360253.032612:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360253.032625:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360253.032628:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.032629:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787360253.032631:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360253.032634:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.032635:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787360253.032639:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff998903b0b000 00000020:00000080:3.0:1787360253.032641:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360253.032728:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360253.032732:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.032734:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787360253.032736:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360253.032739:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.032740:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360253.032744:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998903b0b000 00000020:00000080:3.0:1787360253.032745:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360253.040885:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360253.040896:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.040899:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360253.040903:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360253.040907:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.040908:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787360253.040913:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff998903b0b000 00000020:00000080:3.0:1787360253.040915:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360253.040978:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360253.040982:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360253.040983:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787360253.040986:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787360253.043330:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787360253.043376:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360253.043395:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043407:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360253.043465:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360253.043468:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff998903b0b000 10000000:01000000:0.0:1787360253.043470:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff998903b0b000 10000000:01000000:0.0:1787360253.043475:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360253.043481:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff998903b0b000 from 1 10000000:01000000:0.0:1787360253.043483:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360253.043516:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043524:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043540:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360253.043563:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360253.043625:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.043661:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360253.043694:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132352 00000100:00100000:0.0:1787360253.043701:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132352 00000100:00100000:0.0:1787360253.043739:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360253.043748:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:19525:x1874182596132352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360253.043835:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360253.043848:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caef000/0x359a4e2aee7213ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee7213a4 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043871:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef000/0x359a4e2aee7213ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee7213a4 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043880:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caef000/0x359a4e2aee7213ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7213a4 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.043888:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef000, rc 0) 00000100:00100000:0.0:1787360253.043925:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132352:12345-0@lo:101:mount.lustre.0 Request processed in 178us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.043931:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787360253.043975:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360253.043988:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.044003:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360253.045866:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787360253.046171:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360253.046383:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787360253.046408:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787360253.046423:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787360253.046435:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787360253.046446:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787360253.046459:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787360253.046471:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787360253.046485:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787360253.046501:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787360253.046514:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787360253.046526:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787360253.046539:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787360253.046549:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787360253.046561:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787360253.046572:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787360253.046584:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787360253.046597:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787360253.046610:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787360253.046623:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787360253.046635:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787360253.046647:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787360253.046660:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787360253.046691:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787360253.046707:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787360253.046723:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787360253.046735:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787360253.049308:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787360253.049337:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787360253.049351:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787360253.049364:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787360253.049376:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787360253.049388:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787360253.049401:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787360253.049415:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787360253.049428:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787360253.049441:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787360253.049454:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787360253.049467:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787360253.049499:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787360253.049516:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787360253.049529:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787360253.049542:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787360253.049557:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787360253.049570:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787360253.049585:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787360253.049598:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787360253.049625:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787360253.049631:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787360253.049735:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360253.050902:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.053886:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106afd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.058360:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132480 00000100:00100000:1.0:1787360253.058375:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132480 00000100:00100000:1.0:1787360253.058478:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787360253.058488:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360253.058658:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132480:12345-0@lo:501:mount.lustre.0 Request processed in 170us (7757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.058666:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787360253.058857:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3feb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360253.058911:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360253.058960:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.061944:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.064844:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132608 00000100:00100000:2.0:1787360253.064857:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132608 00000100:00100000:2.0:1787360253.064909:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787360253.064920:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360253.065081:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132608:12345-0@lo:503:mount.lustre.0 Request processed in 162us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.065089:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787360253.065248:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360253.065664:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360253.065737:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360253.065846:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.065880:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20780c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360253.065946:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132736 00000100:00100000:2.0:1787360253.065952:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132736 00000100:00100000:2.0:1787360253.065990:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787360253.065998:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360253.066079:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132736:12345-0@lo:502:mount.lustre.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.066094:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787360253.066146:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360253.066352:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787360253.066378:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787360253.066394:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787360253.066407:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787360253.066420:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787360253.066433:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787360253.066447:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787360253.066462:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787360253.066476:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787360253.066490:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787360253.066503:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787360253.066516:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787360253.066529:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787360253.066542:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787360253.066555:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787360253.066569:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787360253.066582:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787360253.066609:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787360253.066624:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787360253.066636:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787360253.066647:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787360253.066661:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787360253.066675:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787360253.066687:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787360253.066698:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787360253.066710:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787360253.066723:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787360253.066734:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787360253.067511:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787360253.067534:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787360253.067548:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787360253.067561:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787360253.067573:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787360253.067602:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787360253.067618:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787360253.067630:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787360253.067643:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787360253.067657:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787360253.067671:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787360253.067684:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787360253.067698:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787360253.067713:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787360253.067726:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787360253.067740:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787360253.068865:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787360253.068898:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787360253.068914:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787360253.068927:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787360253.068993:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360253.069062:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.069117:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.069179:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132864 00000100:00100000:1.0:1787360253.069187:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132864 00000100:00100000:1.0:1787360253.069256:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787360253.069267:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360253.069383:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132864:12345-0@lo:502:mount.lustre.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.069391:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787360253.069866:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360253.070040:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787360253.070064:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787360253.070087:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360253.070932:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.070973:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a205e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.071033:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596132992 00000100:00100000:1.0:1787360253.071039:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596132992 00000100:00100000:1.0:1787360253.071122:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787360253.071132:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360253.071268:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596132992:12345-0@lo:502:mount.lustre.0 Request processed in 137us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.071275:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787360253.071357:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596132992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360253.071416:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787360253.071427:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787360253.071993:0:19539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787360253.072014:0:19539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9989038e0000) 00000020:00000080:2.0:1787360253.072038:0:19539:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787360253.072115:0:19539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998903b0b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360253.072119:0:19539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998903b0b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360253.072122:0:19539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998903b0b000 3 00010000:00080000:2.0:1787360253.072157:0:19539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9989035fd800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.111@tcp at head 00010000:00010000:2.0:1787360253.073790:0:19539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787360253.073993:0:19539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787360253.074032:0:19539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787360253.074046:0:19539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x359a4e2aee7213b9 00000100:00080000:2.0:1787360253.074055:0:19539:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360253.074061:0:19539:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9989035fd800 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360253.074091:0:19539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a37844a80 x1874182596133120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360253.074146:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596133120:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360253.079718:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360253.079911:0:19539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787360253.080789:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133120 00000100:00100000:0.0:1787360253.080807:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133120 00000100:00100000:0.0:1787360253.080845:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360253.080854:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3657:x1874182596133120:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360253.080880:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1787360253.080918:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x359a4e2aee7213c0 00000004:00100000:0.0:1787360253.080938:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360253.080972:0:17206:0:(import.c:65:import_set_state_nolock()) ffff998902a19000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360253.081046:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1874182596133120:12345-0@lo:38:llog_process_th.0 Request processed in 191us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.081054:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787360253.084057:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37844a80 x1874182596133120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360253.084072:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360253.084081:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787360253.084088:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787360253.084093:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787360253.084096:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989035fd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787360253.084113:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3657:1874182596133120:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787360253.086009:0:19539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787360253.086025:0:19539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9989038e3370) 00000020:00000080:2.0:1787360253.086050:0:19539:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787360253.086140:0:19539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff998903b0b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360253.086144:0:19539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff998903b0b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360253.086147:0:19539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff998903b0b000 3 00010000:00080000:2.0:1787360253.086176:0:19539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9989035f8000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.111@tcp at head 00000100:00080000:1.0:1787360253.088037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360253.088043:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360253.088046:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360253.088049:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360253.088078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360253.088081:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787360253.088085:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360253.088092:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 530 00000100:00080000:1.0:1787360253.088096:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787360253.088112:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:1.0:1787360253.088133:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a3510e680 x1874182596133760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360253.088265:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596133760:0@lo:8:kworker.0 00000100:00100000:3.0:1787360253.088328:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.088377:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133760 00000100:00100000:3.0:1787360253.088383:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133760 00000100:00100000:3.0:1787360253.088418:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360253.088426:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3657:x1874182596133760:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787360253.088481:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3657:x1874182596133760:12345-0@lo:8:kworker.0 Request processed in 54us (153us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787360253.088488:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360253.088525:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360253.088531:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360253.088535:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787360253.088538:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596133760:0@lo:8:kworker.0 00000100:00100000:2.0:1787360253.089172:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596133632:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.089215:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.089336:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596133248:0@lo:400:kworker.0 00000100:00100000:0.0:1787360253.089370:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.089393:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596133888:0@lo:400:kworker.0 00000100:00100000:0.0:1787360253.089417:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.089603:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133248 00000100:00100000:0.0:1787360253.089609:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133248 00000100:00100000:0.0:1787360253.089644:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787360253.089651:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596133248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360253.089697:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596133248:12345-0@lo:400:kworker.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.089704:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787360253.089762:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596133248:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.089916:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596133376:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.089943:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.089961:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596134016:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.089982:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.090006:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787360253.090012:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596133504:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090034:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.090051:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596134144:0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090070:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360253.090098:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133888 00000100:00100000:2.0:1787360253.090114:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133888 00000100:00100000:2.0:1787360253.090136:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133376 00000100:00100000:2.0:1787360253.090139:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133376 00000100:00100000:2.0:1787360253.090149:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134016 00000100:00100000:2.0:1787360253.090151:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134016 00000100:00100000:2.0:1787360253.090162:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134144 00000100:00100000:2.0:1787360253.090164:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134144 00000100:00100000:2.0:1787360253.090177:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360253.090184:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596133888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090220:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596133888:12345-0@lo:400:kworker.0 Request processed in 37us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.090242:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360253.090256:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360253.090261:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596133376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090294:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596133376:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.090310:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360253.090324:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360253.090329:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596134016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090356:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596134016:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.090361:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360253.090372:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360253.090378:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596134144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090402:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596134144:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.090408:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360253.090426:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133504 00000100:00100000:2.0:1787360253.090429:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133504 00000100:00100000:2.0:1787360253.090449:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360253.090455:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596133504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360253.090481:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596133504:12345-0@lo:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360253.090486:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360253.090513:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596133504:0@lo:400:kworker.0 00010000:00080000:2.0:1787360253.090524:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510ed80 x1874182596134144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360253.090533:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596134144:0@lo:400:kworker.0 00010000:00080000:2.0:1787360253.090541:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510d880 x1874182596133376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360253.090560:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596133376:0@lo:400:kworker.0 00010000:00080000:2.0:1787360253.090572:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510d180 x1874182596134016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360253.090579:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596134016:0@lo:400:kworker.0 00010000:00010000:2.0:1787360253.090780:0:19539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:1.0:1787360253.090913:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596133632 00000100:00100000:1.0:1787360253.090919:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596133632 00000100:00100000:1.0:1787360253.090955:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360253.090962:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360253.091010:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596133632:12345-0@lo:400:kworker.0 Request processed in 49us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.091017:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787360253.092020:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510df80 x1874182596133888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360253.092034:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596133888:0@lo:400:kworker.0 00010000:00080000:1.0:1787360253.092972:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a3510e300 x1874182596133632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360253.092984:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596133632:0@lo:400:kworker.0 00000020:00000080:2.0:1787360253.093766:0:19539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787360253.094899:0:19539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787360253.094912:0:19539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x359a4e2aee7213ce 00000100:00080000:2.0:1787360253.094920:0:19539:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360253.094926:0:19539:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9989035f8000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:2.0:1787360253.094953:0:19539:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998a37844e00 x1874182596134272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360253.094974:0:19539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787360253.094996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360253.095000:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787360253.095003:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787360253.095006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787360253.095692:0:19539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1787360253.096981:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787360253.097014:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787360253.097033:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.097044:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caee600/0x359a4e2aee7213a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee7213ab expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787360253.097099:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787360253.097101:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360253.097113:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360253.097114:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360253.097115:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360253.097117:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360253.097118:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360253.097120:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360253.097122:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360253.097126:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787360253.097128:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787360253.097129:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787360253.097130:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787360253.097131:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787360253.097132:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787360253.097133:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787360253.097139:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787360253.097140:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787360253.097141:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787360253.097163:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787360253.097180:0:19525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596134400:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787360253.097279:0:19525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.097320:0:19525:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360253.098959:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134400 00000100:00100000:1.0:1787360253.098971:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134400 00000100:00100000:1.0:1787360253.099024:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787360253.099034:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:19525:x1874182596134400:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787360253.099064:0:17197:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787360253.099079:0:17197:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787360253.101323:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596134272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360253.101399:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.101495:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134272 00000100:00100000:1.0:1787360253.101502:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134272 00000100:00100000:1.0:1787360253.101544:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787360253.101551:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1874182596134272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787360253.101578:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1787360253.101614:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x359a4e2aee7213d5 00000004:00100000:1.0:1787360253.101629:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787360253.101661:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9989037db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360253.101709:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3feb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1874182596134272:12345-0@lo:38:llog_process_th.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.101716:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787360253.101795:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff998a37844e00 x1874182596134272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360253.101878:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360253.101896:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787360253.101903:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787360253.101907:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787360253.101909:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989035f8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787360253.101915:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3657:1874182596134272:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1787360253.107484:0:17197:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787360253.107507:0:17197:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787360253.107717:0:17221:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787360253.107722:0:17221:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787360253.107743:0:17221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.107772:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721349 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.107789:0:17221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721357 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.107797:0:17221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.107943:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.107956:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 24 pid: 17197 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360253.107970:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596134528:0@lo:104: 00000100:00100000:1.0:1787360253.108036:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360253.108098:0:17221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360253.108118:0:17221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 24 pid: 17198 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360253.108127:0:17221:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596134656:0@lo:104: 00000100:00100000:1.0:1787360253.108149:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360253.108168:0:17221:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787360253.108272:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134528 00000100:00100000:0.0:1787360253.108279:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134528 00000100:00100000:0.0:1787360253.108313:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134656 00000100:00100000:0.0:1787360253.108316:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134656 00000100:00100000:0.0:1787360253.108332:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787360253.108340:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596134528:12345-0@lo:104: 00010000:00010000:0.0:1787360253.108352:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108404:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360253.108410:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+4:17221:x1874182596134528:12345-0@lo:104: Request processed in 71us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.108417:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787360253.108433:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360253.108439:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596134656:12345-0@lo:104: 00010000:00010000:0.0:1787360253.108447:0:17189:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108480:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787360253.108484:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:17221:x1874182596134656:12345-0@lo:104: Request processed in 46us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.108500:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787360253.108517:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360253.108523:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108530:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9a00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360253.108534:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108542:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360253.108549:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360253.108555:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360253.108582:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108588:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360253.108606:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108612:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a9a00/0x359a4e2aee721357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72135e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108627:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360253.108630:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108646:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360253.108649:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108655:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360253.108660:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360253.108665:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360253.108679:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108685:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360253.108691:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108697:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998903b71400/0x359a4e2aee721349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721350 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.108709:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360253.108711:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360253.108712:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360253.108719:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360253.108735:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596134912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360253.108900:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.108928:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360253.108934:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596134784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360253.108964:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.108998:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134912 00000100:00100000:0.0:1787360253.109003:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134912 00010000:00010000:0.0:1787360253.109021:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 25 pid: 17198 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360253.109039:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596134784 00000100:00100000:0.0:1787360253.109042:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596134784 00010000:00010000:0.0:1787360253.109052:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 26 pid: 17197 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360253.109064:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787360253.109070:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+26:3659:x1874182596134912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360253.109080:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360253.109085:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 26 pid: 17198 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109095:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 26 pid: 17198 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109119:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360253.109148:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+26:3659:x1874182596134912:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.109154:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787360253.109168:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360253.109174:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+25:3659:x1874182596134784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360253.109181:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360253.109185:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 25 pid: 17197 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109205:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 25 pid: 17197 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109217:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109247:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360253.109260:0:17191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011265149s 00010000:00010000:0.0:1787360253.109264:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109270:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109276:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109281:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109285:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360253.109289:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109296:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109303:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109319:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360253.109343:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+25:3659:x1874182596134784:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.109349:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787360253.109384:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596134784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360253.109392:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596134912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360253.109419:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a067a8a00/0x359a4e2aee72135e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721357 expref: 24 pid: 17197 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360253.109428:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596134528:0@lo:104: 00010000:00010000:0.0:1787360253.109436:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a067a8000/0x359a4e2aee721350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721349 expref: 23 pid: 17198 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360253.109443:0:17221:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17221:1874182596134656:0@lo:104: 00010000:00010000:0.0:1787360253.109455:0:17221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109463:0:17221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109468:0:17221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360253.109474:0:17221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70400/0x359a4e2aee7213dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360253.109588:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:19525:x1874182596134400:12345-0@lo:253:mount.lustre.0 Request processed in 10555us (12309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360253.109598:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787360253.109722:0:19525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9b5a46b1-7024-40db-b9fb-69c8c09a9227:19525:1874182596134400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360253.109739:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787360253.109742:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360253.109744:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787360253.109745:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360253.109746:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360253.109747:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360253.109759:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360253.109761:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787360253.109763:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360253.109764:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360253.109776:0:19525:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1787360253.128936:0:19525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787360253.131731:0:19525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787360253.131740:0:19525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787360253.131797:0:19525:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787360253.131961:0:19525:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787360253.131981:0:19525:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787360253.132006:0:19525:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787360253.134017:0:19525:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360253.134301:0:19525:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787360253.371059:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360253.689935:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596135040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360253.690013:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360253.690408:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135040 00000100:00100000:3.0:1787360253.690416:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135040 00000100:00100000:3.0:1787360253.690467:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360253.690477:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596135040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360253.690510:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360253.690561:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596135040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360253.690569:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360253.690743:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998902917800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596135040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360253.691183:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360253.691195:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596135168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360253.691262:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360253.692426:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135168 00000100:00100000:0.0:1787360253.692435:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135168 00000100:00100000:0.0:1787360253.692483:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787360253.692493:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596135168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360253.692522:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360253.692590:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596135168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360253.692596:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787360253.692638:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596135168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360254.145371:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360234/real 1787360234] req@ffff998a2edddf80 x1874182596121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.145400:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2edddf80 x1874182596121216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.145410:0:3657:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360234/real 1787360234] req@ffff998a2edde300 x1874182596121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360254 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.145422:0:3657:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff998a2edde300 x1874182596121344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360254 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787360254.145450:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360254.145465:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360254.145469:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596121216:0@lo:8:kworker.0 00000100:00080000:0.0:1787360254.145474:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360254.145478:0:3657:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787360254.145481:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596121344:0@lo:8:kworker.0 00000100:00080000:0.0:1787360254.145584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360254.145587:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360254.145590:0:8:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360254.145594:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787360254.145598:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787360254.145604:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9989036e0000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360254.145620:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904814700 x1874182596135552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360254.145632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360254.145635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360254.145636:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360254.145639:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1787360254.145642:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787360254.145644:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff998a3c9c5000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360254.145652:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904815180 x1874182596135680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360254.145689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360254.145696:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360254.145698:0:8:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360254.145703:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff998a042fe000 using connection 192.168.206.111@tcp/0@lo 00000100:00100000:0.0:1787360254.145713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff998904814a80 x1874182596136192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360254.145757:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596135296:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.145838:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596136064:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145858:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.145873:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596136704:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145895:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.145912:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787360254.145917:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596135424:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145937:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.145951:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596136320:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.145977:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596136832:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.145994:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.146068:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596135808:0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146095:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.146121:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596136448:0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146140:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.146150:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787360254.146154:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596135936:0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146170:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.146182:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596136576:0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146200:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.146219:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136064 00000100:00100000:3.0:1787360254.146250:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136064 00000100:00100000:3.0:1787360254.146295:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360254.146313:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596136064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146353:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596136064:12345-0@lo:400:kworker.0 Request processed in 45us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146360:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360254.146380:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136704 00000100:00100000:3.0:1787360254.146383:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136704 00000100:00100000:3.0:1787360254.146399:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136320 00000100:00100000:3.0:1787360254.146401:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136320 00000100:00100000:3.0:1787360254.146410:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136832 00000100:00100000:3.0:1787360254.146412:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136832 00000100:00100000:3.0:1787360254.146421:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135808 00000100:00100000:3.0:1787360254.146423:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135808 00000100:00100000:3.0:1787360254.146431:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136448 00000100:00100000:3.0:1787360254.146433:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136448 00000100:00100000:3.0:1787360254.146442:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136576 00000100:00100000:3.0:1787360254.146443:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136576 00000100:00100000:3.0:1787360254.146454:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360254.146459:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596136704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146484:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596136704:12345-0@lo:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146489:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360254.146500:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360254.146505:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596136320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146527:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596136320:12345-0@lo:400:kworker.0 Request processed in 22us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146533:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360254.146542:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787360254.146548:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596136832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146577:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596136832:12345-0@lo:400:kworker.0 Request processed in 30us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146582:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787360254.146591:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360254.146596:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596135808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146618:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998902916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596135808:12345-0@lo:400:kworker.0 Request processed in 22us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146623:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787360254.146632:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787360254.146637:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596136448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146655:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596136448:12345-0@lo:400:kworker.0 Request processed in 19us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146661:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787360254.146668:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360254.146673:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596136576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146690:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596136576:12345-0@lo:400:kworker.0 Request processed in 18us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146695:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787360254.146709:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135424 00000100:00100000:3.0:1787360254.146711:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135424 00000100:00100000:3.0:1787360254.146729:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135936 00000100:00100000:3.0:1787360254.146731:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135936 00000100:00100000:3.0:1787360254.146741:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787360254.146747:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596135424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146770:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596135424:12345-0@lo:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146784:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787360254.146794:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360254.146799:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596135936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146820:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596135936:12345-0@lo:400:kworker.0 Request processed in 22us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.146825:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787360254.146837:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360254.146841:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787360254.146843:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360254.146867:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596135936:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.146877:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904815500 x1874182596136576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.146886:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596136576:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.146895:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904817b80 x1874182596135808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.146903:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596135808:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.146911:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904817480 x1874182596136448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.146920:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596136448:0@lo:400:kworker.0 00000100:00100000:3.0:1787360254.146952:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596135424:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.146961:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904815880 x1874182596136320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.146969:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596136320:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.146987:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904816300 x1874182596136832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.146994:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596136832:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.147003:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904816680 x1874182596136064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.147010:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596136064:0@lo:400:kworker.0 00010000:00080000:3.0:1787360254.147018:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904814380 x1874182596136704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.147026:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596136704:0@lo:400:kworker.0 00000100:00100000:1.0:1787360254.147185:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135296 00000100:00100000:1.0:1787360254.147189:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135296 00000100:00100000:1.0:1787360254.147215:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787360254.147222:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:3658:x1874182596135296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360254.147272:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:3658:x1874182596135296:12345-0@lo:400:kworker.0 Request processed in 51us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360254.147278:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787360254.147306:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596135296:0@lo:400:kworker.0 00000100:00100000:0.0:1787360254.147954:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596135552:0@lo:8:kworker.0 00000100:00100000:0.0:1787360254.147992:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.148027:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596135680:0@lo:8:kworker.0 00000100:00100000:0.0:1787360254.148047:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.148065:0:3657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596136192:0@lo:8:kworker.0 00000100:00100000:0.0:1787360254.148082:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.148176:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135552 00000100:00100000:3.0:1787360254.148180:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135552 00000100:00100000:3.0:1787360254.148207:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596135680 00000100:00100000:3.0:1787360254.148209:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596135680 00000100:00100000:3.0:1787360254.148216:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136192 00000100:00100000:3.0:1787360254.148218:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136192 00000100:00100000:3.0:1787360254.148247:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360254.148253:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596135552:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787360254.148280:0:18713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:3.0:1787360254.148310:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7213e3 00002000:00100000:3.0:1787360254.148325:0:18713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff998a05835000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787360254.148329:0:18713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787360254.148331:0:18713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787360254.148407:0:18713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787360254.148431:0:18713:0:(import.c:65:import_set_state_nolock()) ffff998a05833800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360254.148476:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596135552:12345-0@lo:8:kworker.0 Request processed in 221us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.148488:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360254.148502:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360254.148506:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596135680:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787360254.148521:0:18713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:3.0:1787360254.148535:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x359a4e2aee7213ea 00002000:00100000:3.0:1787360254.148545:0:18713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff998a05834000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787360254.148548:0:18713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787360254.148550:0:18713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787360254.148677:0:18713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787360254.148690:0:18713:0:(import.c:65:import_set_state_nolock()) ffff998a05832800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360254.148718:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3657:x1874182596135680:12345-0@lo:8:kworker.0 Request processed in 210us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.148723:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360254.148735:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360254.148739:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3657:x1874182596136192:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787360254.148766:0:18713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:3.0:1787360254.148781:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x359a4e2aee7213f1 00002000:00100000:3.0:1787360254.148787:0:18713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff998a05831800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787360254.148790:0:18713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787360254.148792:0:18713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787360254.148814:0:18713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787360254.148826:0:18713:0:(import.c:65:import_set_state_nolock()) ffff998a05831000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360254.148853:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1874182596136192:12345-0@lo:8:kworker.0 Request processed in 112us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360254.148859:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787360254.148902:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904814700 x1874182596135552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.148912:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360254.148919:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787360254.148926:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787360254.148931:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787360254.148933:0:3657:0:(import.c:65:import_set_state_nolock()) ffff9989036e0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787360254.148947:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787360254.148952:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596135552:0@lo:8:kworker.0 00010000:00080000:3.0:1787360254.148963:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904815180 x1874182596135680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360254.148970:0:3657:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360254.148973:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787360254.148977:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787360254.148980:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787360254.148981:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a3c9c5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787360254.148992:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787360254.148995:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3657:1874182596135680:0@lo:8:kworker.0 00010000:00080000:3.0:1787360254.149004:0:3657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904814a80 x1874182596136192/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787360254.149011:0:3657:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787360254.149015:0:3657:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787360254.149017:0:3657:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787360254.149019:0:3657:0:(import.c:65:import_set_state_nolock()) ffff998a042fe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787360254.149027:0:3657:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787360254.149030:0:3657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3657:1874182596136192:0@lo:8:kworker.0 00000004:00080000:3.0:1787360254.149092:0:17230:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787360254.149123:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17230:1874182596137088:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360254.149152:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.149168:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a73c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787360254.149182:0:17229:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787360254.149270:0:17229:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 532396043112ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787360254.149276:0:17229:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787360254.149310:0:17232:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787360254.149323:0:17232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17232:1874182596137344:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787360254.149346:0:17232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.149360:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a134a7900 going to sleep for 11 seconds 00000004:00080000:3.0:1787360254.149370:0:17950:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787360254.149413:0:17950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 532396186502ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787360254.149418:0:17950:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787360254.149438:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596136960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360254.149463:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.149483:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360254.149488:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596137216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360254.149508:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.149531:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137088 00000100:00100000:3.0:1787360254.149535:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137088 00000100:00100000:3.0:1787360254.149567:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137344 00000100:00100000:3.0:1787360254.149571:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137344 00000100:00100000:3.0:1787360254.149587:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360254.149594:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17230:x1874182596137088:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360254.149876:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360254.149886:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17232:x1874182596137344:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787360254.150250:0:17951:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787360254.150268:0:17951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137600:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787360254.150298:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360254.150313:0:17951:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360254.150332:0:18714:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787360254.150338:0:18714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787360254.150457:0:18711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787360254.150466:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137600 00000100:00100000:1.0:1787360254.150470:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137600 00000100:00100000:1.0:1787360254.150504:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596137472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360254.150535:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787360254.151528:0:17231:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787360254.151611:0:17231:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 532398384904ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787360254.151618:0:17231:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787360254.151920:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360254.151933:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17951:x1874182596137600:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787360254.152791:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596136960 00000100:00100000:0.0:1787360254.152801:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596136960 00000100:00100000:0.0:1787360254.152834:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137216 00000100:00100000:0.0:1787360254.152837:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137216 00000100:00100000:0.0:1787360254.152849:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137472 00000100:00100000:0.0:1787360254.152852:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137472 00000100:00100000:0.0:1787360254.152866:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360254.152875:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596136960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360254.152899:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360254.152977:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596136960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360254.152985:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360254.153001:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360254.153007:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596137216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360254.153016:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787360254.153043:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1874182596137216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360254.153049:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360254.153059:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360254.153065:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596137472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360254.153073:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787360254.153114:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3658:x1874182596137472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360254.153126:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787360254.155014:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904914000 x1874182596137472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.155039:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596137472:0@lo:13:osp-pre-1-1.0 00002000:00080000:2.0:1787360254.155906:0:19590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787360254.155912:0:19590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787360254.155998:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17951:x1874182596137600:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4066us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360254.156007:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787360254.156221:0:17951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998904917b80 x1874182596137600/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787360270 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360254.156253:0:17951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137600:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787360254.156264:0:17951:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787360254.156297:0:17951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137728:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787360254.156326:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360254.156356:0:17951:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360254.156371:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137728 00000100:00100000:1.0:1787360254.156377:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137728 00000100:00100000:1.0:1787360254.156408:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360254.156415:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17951:x1874182596137728:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787360254.156436:0:18711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1787360254.156461:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17951:x1874182596137728:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360254.156468:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787360254.156490:0:17951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510e680 x1874182596137728/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787360270 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360254.156499:0:17951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137728:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787360254.156507:0:17951:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1787360254.156528:0:17951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137856:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787360254.156549:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360254.156560:0:17951:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e900 going to sleep for 11 seconds 00000004:00080000:1.0:1787360254.157781:0:17939:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787360254.161217:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137856 00000100:00100000:2.0:1787360254.161243:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137856 00000100:00100000:2.0:1787360254.161300:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360254.161309:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17951:x1874182596137856:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787360254.161348:0:19590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1787360254.162192:0:18713:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787360254.162199:0:18713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787360254.162204:0:18713:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:3.0:1787360254.163857:0:19239:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787360254.163867:0:19239:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787360254.163872:0:19239:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:0.0:1787360254.165525:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2eddc700 x1874182596137216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.165553:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596137216:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787360254.165567:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a2edddc00 x1874182596136960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360254.165579:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2edddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596136960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787360254.165738:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360254.165744:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1787360254.172772:0:19593:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360254.172968:0:19593:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000004:00080000:0.0:1787360254.173714:0:17185:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787360254.174441:0:17185:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787360254.176153:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.176163:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176179:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.176184:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.176190:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176242:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176253:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176261:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176278:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.176288:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.176293:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176300:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.176304:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176313:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176327:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176334:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee7213f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.176356:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.176357:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.176359:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.177333:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.177343:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177354:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.177357:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.177363:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177374:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177383:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177390:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177407:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.177415:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.177420:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177438:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.177441:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177449:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177461:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177469:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee7213ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.177482:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.177484:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.177486:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.179554:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.179565:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.179580:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.179584:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.180576:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183723:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183755:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183764:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183788:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.183805:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.183811:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183818:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.183823:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183833:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183849:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183856:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.183876:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.183882:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.183883:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.186440:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.186452:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186468:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.186472:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.186478:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186491:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186500:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186507:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186526:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.186865:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.186871:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186880:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.186883:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.186888:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186903:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186911:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186917:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186931:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360254.186940:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360254.186945:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186953:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.186957:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186966:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186981:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.186988:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72140d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187009:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.187012:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187019:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.187022:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187029:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187039:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187045:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.187056:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.187057:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.187059:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.187326:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.187612:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.187619:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.187629:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.187632:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.187637:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.187647:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.187654:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.187668:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.187681:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.187992:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.187998:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.188007:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.188016:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.188025:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.188038:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.188045:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000691c3b37/0x359a4e2aee72141b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.188060:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.188061:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.188063:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.189470:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.189480:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.189494:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.189498:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.189503:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.189515:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.189524:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.189539:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.189556:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360254.189910:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360254.189916:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.189924:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360254.189928:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.189935:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.189949:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.189955:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.189972:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.189974:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.189976:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.190406:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.190421:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.190431:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.190435:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.190439:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.190449:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.190458:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.190465:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.190478:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.190748:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.190755:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.190763:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.190767:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.190776:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.190788:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.190796:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a4ce2c1/0x359a4e2aee721429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.190810:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.190811:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.190813:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.191538:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.191551:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.191562:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.191566:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.191571:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.191580:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.191587:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.191594:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.191616:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360254.191899:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360254.191906:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.191914:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360254.191919:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.191928:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.191947:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.191954:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000724f76a7/0x359a4e2aee721430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.191969:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.191971:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.191972:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.192133:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.192139:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.192148:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.192151:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.192154:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.192162:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.192169:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.192176:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.192203:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.192332:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.192337:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.192345:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.192349:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.192357:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.192374:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.192381:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0e00d12/0x359a4e2aee721437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.192394:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.192395:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.192397:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.199089:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.199113:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199132:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.199136:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.199143:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199163:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199173:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199181:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199199:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787360254.199398:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.199405:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199413:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.199422:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.199426:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199437:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199445:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199452:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199469:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787360254.199478:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360254.199484:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199492:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.199496:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199505:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199519:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199538:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd1b50f5/0x359a4e2aee72143e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199562:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.199566:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199573:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.199576:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199585:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199596:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199604:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000432d2e39/0x359a4e2aee721445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.199615:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.199617:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.199619:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.199883:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.203086:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.203108:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.203130:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.203134:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.203140:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.203155:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.203165:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.203174:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.203188:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.203362:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.203369:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203378:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.203381:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.203385:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203396:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203404:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203411:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203435:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360254.203444:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360254.203449:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203457:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.203462:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203471:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203487:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203494:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d32182/0x359a4e2aee72144c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203512:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.203516:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203522:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.203525:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203542:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203553:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203561:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a533302/0x359a4e2aee721453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.203572:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.203574:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.203576:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.206906:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.206918:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.206933:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.206937:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.206944:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.206958:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.206969:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.206985:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207005:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.207371:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.207377:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207387:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.207390:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.207395:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207404:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207413:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207420:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207427:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787360254.207635:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.207641:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207655:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.207658:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.207662:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207672:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207680:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207688:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.207697:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787360254.208563:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.208572:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208582:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.208585:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.208590:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208601:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208621:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208629:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208639:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787360254.208891:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.208897:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208906:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.208908:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.208912:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208920:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208927:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208934:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.208953:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1787360254.209314:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787360254.209321:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209329:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.209334:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209342:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209368:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209376:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef98b4ae/0x359a4e2aee72145a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209393:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787360254.209397:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209403:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.209406:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209413:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209422:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209428:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000084c452/0x359a4e2aee721461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209439:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787360254.209442:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209453:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.209457:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209465:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209476:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209482:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069278216/0x359a4e2aee721468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209493:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360254.209497:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209503:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.209506:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209512:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209521:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209534:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cc04a01/0x359a4e2aee72146f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209547:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.209550:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209557:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.209560:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209566:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209575:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209582:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088190771/0x359a4e2aee721476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209592:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.209594:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.209596:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.209865:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.209872:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209890:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.209893:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.209898:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209909:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209917:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209924:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.209943:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787360254.210253:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.210260:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210268:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.210271:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.210276:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210285:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210304:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210312:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210320:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360254.210567:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360254.210573:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210581:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.210586:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210595:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210608:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210616:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5622c2d/0x359a4e2aee72147d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210631:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.210634:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210641:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.210644:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210663:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210673:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210680:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001137dd69/0x359a4e2aee721484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.210690:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.210692:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.210694:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.210796:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.210802:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210811:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.210814:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.210819:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210828:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210836:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210845:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.210865:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.211120:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.211125:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211133:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.211136:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211143:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211154:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211171:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc077d9/0x359a4e2aee72148b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211187:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.211189:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.211190:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.211253:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.211258:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211267:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.211270:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.211274:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211283:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211290:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211298:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211312:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.211593:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.211603:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211611:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.211614:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.211619:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211628:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211635:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211641:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.211649:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787360254.211905:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360254.211911:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211918:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.211921:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211928:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211941:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211949:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee721492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211962:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.211965:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211971:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.211973:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.211991:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212001:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212008:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721499 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212018:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.212019:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.212021:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.212119:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.212125:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212133:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.212136:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.212140:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212149:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212162:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212170:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212181:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360254.212440:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.212446:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212454:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.212458:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212466:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212477:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212496:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a82b66a/0x359a4e2aee7214a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212509:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.212511:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.212512:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.212547:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.212552:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212561:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.212564:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.212569:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212579:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212587:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212594:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.212608:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.212840:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.212845:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212853:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.212856:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212865:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212876:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212884:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006898cfb7/0x359a4e2aee7214a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.212900:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.212907:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.212909:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.212986:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.212996:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.213005:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.213008:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.213012:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.213021:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.213029:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.213037:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.213049:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.213283:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.213288:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213295:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.213298:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213305:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213315:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213322:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457d3375/0x359a4e2aee7214ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213334:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.213336:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.213337:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.213371:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.213375:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213382:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.213385:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.213395:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213404:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213411:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213418:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213430:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.213517:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.213521:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213528:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681600 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.213532:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213539:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213549:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213567:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5e1b72b/0x359a4e2aee7214b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213580:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.213582:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.213583:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.213815:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.213821:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213830:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.213833:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.213838:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213847:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213855:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213863:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.213875:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.214091:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.214111:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.214120:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.214123:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.214127:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.214136:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.214144:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.214152:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.214161:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787360254.214388:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.214394:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214401:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.214404:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.214408:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214417:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214430:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214438:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214446:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787360254.214686:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.214692:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214700:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.214703:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.214707:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214716:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214724:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214732:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.214799:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787360254.215047:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.215052:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215060:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.215062:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.215066:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215075:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215090:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215107:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215116:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787360254.215359:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.215365:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.215374:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.215377:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.215381:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.215390:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.215398:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.215406:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.215414:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787360254.215677:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.215683:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215691:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.215694:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.215699:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215708:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215716:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215724:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215754:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1787360254.215827:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787360254.215834:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215842:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.215847:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215856:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215871:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215879:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f61d6b/0x359a4e2aee7214bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215897:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787360254.215901:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215907:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.215910:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215928:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215938:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215945:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000774dced/0x359a4e2aee7214c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215959:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787360254.215962:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215969:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.215973:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215979:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215988:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.215994:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d808bebd/0x359a4e2aee7214ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216021:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787360254.216024:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216031:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.216034:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216041:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216050:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216057:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b252f96/0x359a4e2aee7214d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216068:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787360254.216072:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216078:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.216081:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216109:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216120:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216127:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05c350/0x359a4e2aee7214d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216140:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360254.216143:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216149:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.216152:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216158:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216165:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216172:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e068c908/0x359a4e2aee7214df lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216193:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.216196:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216201:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.216204:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216211:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216220:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216245:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee7214e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216256:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.216258:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.216259:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.216365:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.216372:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.216380:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.216388:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.216392:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.216401:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.216408:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.216415:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.216435:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360254.216562:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.216567:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216575:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.216583:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216591:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216602:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216610:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ca65bfb/0x359a4e2aee7214ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.216623:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.216624:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.216626:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.217486:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.217644:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.217652:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.217664:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.217667:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.217672:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.217683:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.217692:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.217707:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.217730:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360254.218026:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360254.218032:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.218040:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01516000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360254.218044:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.218051:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.218067:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.218073:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000908f2d02/0x359a4e2aee7214f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.218090:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.218092:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.218094:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787360254.221430:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787360254.221444:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221460:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:3.0:1787360254.221464:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360254.221470:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221483:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221492:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221499:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221520:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360254.221702:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.221708:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221724:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01517000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.221728:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221737:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221761:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221769:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068edad32/0x359a4e2aee7214fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.221793:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.221795:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.221797:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360254.222093:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.222110:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222120:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.222123:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.222128:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222138:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222146:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222161:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222178:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360254.222499:0:18713:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.222505:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222514:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.222517:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.222521:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222530:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222538:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222546:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222561:0:18713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360254.222568:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360254.222572:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222585:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.222589:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222597:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222610:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222618:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec85f0bb/0x359a4e2aee721502 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222632:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360254.222635:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222641:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360254.222645:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222652:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222661:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222674:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee721509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.222688:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.222689:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.222691:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787360254.222725:0:18713:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1787360254.222821:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17230:x1874182596137088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73224us (73664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360254.222830:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787360254.222994:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360254.223028:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17230:1874182596137088:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787360254.223042:0:17230:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787360254.223080:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17230:1874182596137984:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787360254.223120:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.223137:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360254.223188:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596137984 00000100:00100000:1.0:1787360254.223195:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596137984 00000100:00100000:1.0:1787360254.223255:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360254.223263:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17230:x1874182596137984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787360254.223292:0:18714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:1.0:1787360254.223634:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.223640:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.223653:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.223656:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.223661:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.223672:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.223691:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.223699:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.223869:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360254.228311:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.228323:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.228354:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.228358:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.228365:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.228380:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.228391:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.228399:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228703:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360254.228711:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228725:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.228729:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228737:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228762:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228769:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2355649/0x359a4e2aee721510 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228789:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360254.228793:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228799:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360254.228802:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228808:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228817:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360254.228829:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.228831:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.228832:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787360254.229717:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787360254.229811:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787360254.229996:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2edddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17230:x1874182596137984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6728us (6870us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787360254.230006:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360254.231197:0:17230:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1787360254.231208:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17230:1874182596137984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787360254.231248:0:17230:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1787360254.234970:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360254.234985:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0e00d12/0x359a4e2aee721517 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360254.235571:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.235579:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.235592:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.235597:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.235602:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.235627:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.235636:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.235643:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.235666:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.235879:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.235886:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.235894:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22696000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.235899:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.235908:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.235939:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.235946:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4ce2c1/0x359a4e2aee72151e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.235963:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.235965:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.235968:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.236044:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.236049:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236057:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.236060:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.236063:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236072:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236079:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236105:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236124:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.236407:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.236412:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236419:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a22697800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.236422:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236429:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236441:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236448:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000691c3b37/0x359a4e2aee721525 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236474:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.236476:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.236477:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.236556:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.236562:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236570:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.236573:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.236577:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236586:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236593:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236599:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.236622:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.236878:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.236883:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236890:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.236894:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236901:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236914:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236920:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a82b66a/0x359a4e2aee72152c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.236933:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.236935:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.236936:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.237010:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.237016:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237029:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.237032:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.237036:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237047:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237054:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237060:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237079:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.237304:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.237309:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237328:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70400 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.237331:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237340:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237350:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237356:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f097c1f/0x359a4e2aee721533 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237368:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.237370:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.237372:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.237450:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.237456:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237464:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.237467:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.237471:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237480:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237499:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237517:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237533:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.237727:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.237732:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237750:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.237753:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237761:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237777:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237783:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000411833d5/0x359a4e2aee72153a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.237796:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.237797:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.237799:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.237899:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.237905:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237912:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.237915:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.237918:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237927:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237934:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237941:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.237971:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.238200:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.238205:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238212:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.238216:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238247:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238260:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238266:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088190771/0x359a4e2aee721541 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238290:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.238292:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.238293:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.238377:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.238383:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238392:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.238395:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.238399:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238408:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238416:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238423:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238442:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.238662:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.238667:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238675:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71000 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.238678:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238686:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238697:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238704:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc04a01/0x359a4e2aee721548 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.238717:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.238718:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.238720:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.238794:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.238800:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238808:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.238817:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.238822:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238832:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238841:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238848:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.238869:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360254.239119:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.239125:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.239143:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71a00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.239147:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.239156:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.239167:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.239174:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069278216/0x359a4e2aee72154f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.239188:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.239190:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.239191:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360254.239336:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787360254.239342:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.239350:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1787360254.239353:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360254.239357:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.239366:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.239373:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.239387:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.239434:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1787360254.241148:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787360254.241174:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787360254.241179:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787360254.241353:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17951:x1874182596137856:12345-0@lo:5:osp-pre-1-1.0 Request processed in 80040us (84797us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787360254.241363:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360254.241408:0:17951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787360254.241414:0:17951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17951:1874182596137856:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787360254.241427:0:17951:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787360254.241469:0:17951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17951:1874182596138112:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787360254.241496:0:17951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360254.241519:0:17951:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360254.241535:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138112 00000100:00100000:1.0:1787360254.241540:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138112 00000100:00100000:1.0:1787360254.241572:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787360254.241579:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17951:x1874182596138112:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787360254.241616:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17951:x1874182596138112:12345-0@lo:900:osp-pre-1-1.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360254.241630:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787360254.241657:0:17951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a3510e680 x1874182596138112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787360270 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360254.241667:0:17951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17951:1874182596138112:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787360254.244759:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.244772:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.244788:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.244792:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.244798:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.244812:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.244822:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.244830:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245843:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360254.245852:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245863:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.245868:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245879:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245903:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245911:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000084c452/0x359a4e2aee721556 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245933:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.245937:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245943:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.245947:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245954:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245963:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.245970:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.245971:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.245973:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360254.246053:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.246404:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787360254.246411:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee72155d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360254.247960:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.247970:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.247986:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.247991:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.247996:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.248009:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.248019:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.248027:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.249076:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.249087:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.249117:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.249122:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.249131:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.249149:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.249159:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.249160:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.249162:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.249948:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787360254.249957:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec85f0bb/0x359a4e2aee721564 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360254.250406:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.250413:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.250434:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.250438:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.250443:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.250455:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.250465:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.250473:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.254904:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360254.254918:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.254932:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360254.254937:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.254948:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.254968:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360254.254979:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.254981:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360254.254983:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.255918:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787360254.255928:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bdd6b10/0x359a4e2aee72156b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360254.256511:0:19239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787360254.256518:0:19239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.256532:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1787360254.256536:0:19239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360254.256542:0:19239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.256566:0:19239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.256575:0:19239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360254.256582:0:19239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.259274:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360254.259287:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.259300:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360254.259305:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.259316:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.259336:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360254.259352:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.259354:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360254.259356:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360254.259713:0:19239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787360254.259720:0:19239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071af64f6/0x359a4e2aee721572 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787360254.259864:0:19239:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787360254.259938:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17232:x1874182596137344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 110051us (110588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360254.259948:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360254.260030:0:17232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17232:1874182596137344:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360254.260045:0:17232:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1787360254.260084:0:17232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17232:1874182596138240:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787360254.260274:0:17232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360254.260294:0:17232:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a22573c00 going to sleep for 11 seconds 00010000:00010000:3.0:1787360254.260305:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360254.260351:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138240 00000100:00100000:1.0:1787360254.260357:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138240 00000100:00100000:1.0:1787360254.260396:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787360254.260404:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17232:x1874182596138240:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787360254.260433:0:18713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1787360254.264061:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17232:x1874182596138240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3652us (3781us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787360254.264073:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360254.264214:0:17232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17232:1874182596138240:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360254.264252:0:17232:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1787360254.396045:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787360255.039974:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787360255.039981:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9989029fe800 from 10 10000000:01000000:1.0:1787360255.039985:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787360255.040025:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360255.040036:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360255.040047:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360255.040071:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360255.040144:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360255.040191:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a20558600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360255.040204:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138368 00000100:00100000:2.0:1787360255.040211:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138368 00000100:00100000:3.0:1787360255.040919:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787360255.040937:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596138368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360255.040955:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360255.040969:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517000/0x359a4e2aee721580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721579 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360255.040992:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517000/0x359a4e2aee721580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721579 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360255.041003:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517000/0x359a4e2aee721580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721579 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360255.041011:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517000, rc 0) 00000100:00100000:3.0:1787360255.041064:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596138368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360255.041071:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787360255.041220:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360255.041251:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360255.041266:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360255.041331:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787360255.041501:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360255.041532:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3130e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360255.041985:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138496 00000100:00100000:3.0:1787360255.041992:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138496 00000100:00100000:3.0:1787360255.042040:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787360255.042049:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596138496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787360255.042067:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787360255.042082:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787360255.042085:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787360255.042179:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596138496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360255.042186:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787360255.045432:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360255.045513:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360255.045522:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360255.045532:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06680c00/0x359a4e2aee721579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721580 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360255.045541:0:17202:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360255.045544:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff998a3d61f800 from 10 10000000:01000000:0.0:1787360255.045546:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360255.045574:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360255.045582:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360255.045591:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360255.045608:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360255.045670:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360255.045706:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360255.046322:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138624 00000100:00100000:1.0:1787360255.046330:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138624 00000100:00100000:1.0:1787360255.046377:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787360255.046445:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596138624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787360255.046459:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360255.046472:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a06681c00/0x359a4e2aee72158e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721587 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360255.046497:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a06681c00/0x359a4e2aee72158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721587 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360255.046508:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a06681c00/0x359a4e2aee72158e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721587 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360255.046516:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681c00, rc 0) 00000100:00100000:1.0:1787360255.046577:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596138624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360255.046583:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787360255.046655:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360255.046677:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360255.046685:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360255.046737:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787360255.046784:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360255.046815:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b9ca3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360255.046911:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138752 00000100:00100000:1.0:1787360255.046916:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138752 00000100:00100000:1.0:1787360255.046947:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787360255.046953:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596138752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787360255.046966:0:17197:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787360255.046982:0:17197:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787360255.046984:0:17197:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1787360255.047063:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596138752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360255.047070:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787360255.047192:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904914000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596138752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360255.047269:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360255.047276:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360255.047283:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a3caefc00/0x359a4e2aee721587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72158e expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360255.418391:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360255.806278:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787360256.444294:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360257.465397:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360257.794244:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360257.794266:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596138880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787360257.794328:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360257.794370:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596138880 00000100:00100000:2.0:1787360257.794377:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596138880 00000100:00100000:2.0:1787360257.794432:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360257.794441:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596138880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360257.794468:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787360257.794504:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596138880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360257.794511:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787360257.794526:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360257.794554:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596138880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787360258.491398:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360258.810015:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596139008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360258.810097:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360258.810172:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139008 00000100:00100000:1.0:1787360258.810179:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139008 00000100:00100000:1.0:1787360258.810251:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360258.810259:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596139008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787360258.810290:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360258.810333:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596139008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360258.810340:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787360258.810386:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3510df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596139008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360258.811321:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596139136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360258.811373:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360258.811518:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139136 00000100:00100000:3.0:1787360258.811529:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139136 00000100:00100000:3.0:1787360258.811952:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360258.811965:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596139136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787360258.811992:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360258.812049:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3510df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596139136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360258.812055:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787360258.812131:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a37846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596139136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360259.325656:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360259.325689:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360259.325767:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596139520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360259.325832:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360259.326771:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596139776:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.333458:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360259.333524:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139520 00000100:00100000:3.0:1787360259.333532:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139520 00000100:00100000:3.0:1787360259.333577:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139392 00000100:00100000:3.0:1787360259.333580:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139392 00000100:00100000:3.0:1787360259.333604:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360259.333613:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596139520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787360259.333643:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360259.333961:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596139520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 348us (8128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360259.333969:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360259.333987:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360259.333995:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596139392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360259.334006:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787360259.334031:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596139392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360259.334037:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787360259.334054:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360259.334068:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596139520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360259.334091:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596140032:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.334096:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360259.334103:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360259.334124:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360259.334125:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360259.334143:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139264 00000100:00100000:1.0:1787360259.334143:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596140544:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.334146:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139264 00000100:00100000:1.0:1787360259.334164:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360259.334171:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360259.334177:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596139264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360259.334187:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787360259.334197:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787360259.334204:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596139648:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.334213:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596139264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360259.334218:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787360259.334250:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360259.334269:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2eddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360259.334286:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139904:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.334310:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360259.334408:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360259.334433:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596140160:0@lo:400:kworker.0 00000100:00100000:1.0:1787360259.334468:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140032 00000100:00100000:1.0:1787360259.334472:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140032 00000100:00100000:1.0:1787360259.334507:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140544 00000100:00100000:1.0:1787360259.334510:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140544 00000100:00100000:1.0:1787360259.334535:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360259.334541:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596140032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360259.334577:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596140032:12345-0@lo:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360259.334583:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787360259.334595:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787360259.334600:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596140544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360259.334625:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596140544:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360259.334639:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787360259.334660:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139648 00000100:00100000:1.0:1787360259.334663:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139648 00000100:00100000:1.0:1787360259.334686:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787360259.334692:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596139648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360259.334721:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596139648:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360259.334726:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1787360259.334747:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360259.334906:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139904 00000100:00100000:1.0:1787360259.334911:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139904 00000100:00100000:1.0:1787360259.334938:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360259.334944:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596139904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337447:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360259.337508:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596140672:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337563:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787360259.337604:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890415a680 x1874182596140032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360259.337617:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596140032:0@lo:400:kworker.0 00010000:00080000:0.0:1787360259.337631:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a1500 x1874182596140544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360259.337653:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596140544:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337679:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596139648:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337708:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360259.337732:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596140288:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337756:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360259.337774:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596140800:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337793:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360259.337828:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140160 00000100:00100000:0.0:1787360259.337833:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140160 00000100:00100000:0.0:1787360259.337872:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596139776 00000100:00100000:0.0:1787360259.337875:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596139776 00000100:00100000:0.0:1787360259.337886:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140288 00000100:00100000:0.0:1787360259.337888:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140288 00000100:00100000:0.0:1787360259.337900:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360259.337908:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596140160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.337953:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596140160:12345-0@lo:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.337960:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360259.337975:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360259.337981:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338011:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596139776:12345-0@lo:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.338017:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360259.338026:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360259.338032:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596140288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338067:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596140288:12345-0@lo:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.338398:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360259.338421:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140672 00000100:00100000:0.0:1787360259.338424:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140672 00000100:00100000:0.0:1787360259.338449:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140800 00000100:00100000:0.0:1787360259.338452:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140800 00000100:00100000:0.0:1787360259.338473:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787360259.338479:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596140672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338513:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1874182596140672:12345-0@lo:400:kworker.0 Request processed in 34us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.338519:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787360259.338529:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787360259.338535:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596140800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338558:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596140800:12345-0@lo:400:kworker.0 Request processed in 24us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.338563:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787360259.338583:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360259.338587:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360259.338589:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360259.338607:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596139776:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338617:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596140288:0@lo:400:kworker.0 00010000:00080000:0.0:1787360259.338626:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a2680 x1874182596140800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360259.338635:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596140800:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.338700:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596140160:0@lo:400:kworker.0 00010000:00080000:0.0:1787360259.338711:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a0000 x1874182596140672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360259.338719:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3660:1874182596140672:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.340809:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596140416:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.340846:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360259.340854:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1874182596139904:12345-0@lo:400:kworker.0 Request processed in 5909us (6541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360259.340866:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360259.340872:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596140928:0@lo:400:kworker.0 00000100:00100000:0.0:1787360259.342546:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140416 00000100:00100000:0.0:1787360259.342560:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140416 00000100:00100000:0.0:1787360259.342612:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787360259.342621:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596140416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.345523:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360259.345576:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596140928 00000100:00100000:3.0:1787360259.345585:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596140928 00000100:00100000:0.0:1787360259.345602:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1874182596140416:12345-0@lo:400:kworker.0 Request processed in 2979us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360259.345616:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360259.345655:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360259.345665:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596140928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.345710:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1874182596140928:12345-0@lo:400:kworker.0 Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360259.345738:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787360259.345757:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1787360259.345789:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a0a80 x1874182596140928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360259.345803:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3659:1874182596140928:0@lo:400:kworker.0 00000100:00100000:3.0:1787360259.345833:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596139904:0@lo:400:kworker.0 00010000:00080000:3.0:1787360259.345843:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9989040a1f80 x1874182596140416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360259.345849:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3659:1874182596140416:0@lo:400:kworker.0 00010000:00010000:3.0:1787360259.513398:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787360259.778857:0:19883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg611-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:3.0:1787360259.847330:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1787360260.543997:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787360260.739627:0:19935:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360260.740052:0:19935:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787360261.561358:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787360261.650680:0:19985:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787360261.650896:0:19985:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787360262.000480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.000720:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083136 00000100:00100000:0.0:1787360262.000731:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083136 00000100:00100000:0.0:1787360262.000783:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 115 00000100:00100000:0.0:1787360262.000791:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1874182575083136:12345-192.168.206.11@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787360262.000818:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 14e95e5c-9854-457b-a93b-73582689ff25@192.168.206.11@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1787360262.000843:0:17198:0:(genops.c:1385:class_connect()) connect: client 14e95e5c-9854-457b-a93b-73582689ff25, cookie 0x359a4e2aee721595 00000100:00080000:0.0:1787360262.000974:0:17198:0:(import.c:65:import_set_state_nolock()) ffff998a043a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360262.001066:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+5:2398:x1874182575083136:12345-192.168.206.11@tcp:250:mount.lustre.0 Request processed in 265us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.001075:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 115 00000040:00080000:2.0:1787360262.010792:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787360262.012754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.013197:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083264 00000100:00100000:2.0:1787360262.013212:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083264 00000100:00100000:0.0:1787360262.014209:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:0.0:1787360262.014279:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+5:14907:x1874182575083264:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360262.014322:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360262.014346:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caeee00/0x359a4e2aee72159c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3ce expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.014384:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caeee00/0x359a4e2aee72159c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ce expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.014398:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caeee00/0x359a4e2aee72159c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3ce expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.014409:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caeee00, rc 0) 00000100:00100000:0.0:1787360262.014607:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+6:14907:x1874182575083264:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 380us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.017577:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.018068:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083392 00000100:00100000:1.0:1787360262.018082:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083392 00000100:00100000:0.0:1787360262.019646:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 116 00000100:00100000:1.0:1787360262.020161:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:1.0:1787360262.020182:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+6:14907:x1874182575083392:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360262.020370:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+6:14907:x1874182575083392:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 197us (2806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360262.020397:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 117 00000100:00100000:3.0:1787360262.029554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.029935:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083520 00000100:00100000:0.0:1787360262.030065:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083520 00000100:00100000:0.0:1787360262.030163:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:0.0:1787360262.030173:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+6:14907:x1874182575083520:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360262.030189:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360262.030205:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caef800/0x359a4e2aee7215a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef3d5 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.030286:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef800/0x359a4e2aee7215a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3d5 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.030299:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caef800/0x359a4e2aee7215a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef3d5 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.030329:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef800, rc 0) 00000100:00100000:0.0:1787360262.030395:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+7:14907:x1874182575083520:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 223us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.030401:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 118 00000100:00100000:3.0:1787360262.035689:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.038164:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083648 00000100:00100000:0.0:1787360262.038185:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083648 00000100:00100000:0.0:1787360262.038319:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:0.0:1787360262.038332:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+7:14907:x1874182575083648:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787360262.038548:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+8:14907:x1874182575083648:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 218us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.038558:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 119 00000100:00100000:0.0:1787360262.045593:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.048477:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083776 00000100:00100000:1.0:1787360262.048491:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083776 00000100:00100000:1.0:1787360262.048547:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1787360262.048557:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+8:14907:x1874182575083776:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787360262.049031:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+8:14907:x1874182575083776:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 473us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360262.049039:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 120 00000100:00100000:1.0:1787360262.060896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.061081:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575083904 00000100:00100000:3.0:1787360262.061091:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575083904 00000100:00100000:3.0:1787360262.061149:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:3.0:1787360262.061159:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575083904:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360262.061345:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575083904:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 187us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.061354:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 121 00000100:00100000:3.0:1787360262.095210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.096169:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084032 00000100:00100000:1.0:1787360262.096179:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084032 00000100:00100000:0.0:1787360262.097526:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:0.0:1787360262.097539:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575084032:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360262.097713:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575084032:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 169us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.097721:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 122 00000100:00100000:1.0:1787360262.105960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.106814:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084160 00000100:00100000:2.0:1787360262.106824:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084160 00000100:00100000:2.0:1787360262.106898:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:2.0:1787360262.106908:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575084160:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360262.107049:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+8:14927:x1874182575084160:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 141us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360262.107067:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 123 00000100:00100000:1.0:1787360262.112422:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.112542:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084288 00000100:00100000:0.0:1787360262.112552:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084288 00000100:00100000:0.0:1787360262.112608:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:0.0:1787360262.112617:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+8:14907:x1874182575084288:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360262.112633:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360262.112647:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a3caef600/0x359a4e2aee7215aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef406 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.112697:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a3caef600/0x359a4e2aee7215aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef406 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.112716:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a3caef600/0x359a4e2aee7215aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef406 expref: 9 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360262.112726:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a3caef600, rc 0) 00000100:00100000:0.0:1787360262.112784:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+9:14907:x1874182575084288:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 168us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.112792:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 124 00000100:00100000:1.0:1787360262.118979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.119164:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084416 00000100:00100000:3.0:1787360262.119177:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084416 00000100:00100000:3.0:1787360262.119269:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:3.0:1787360262.119282:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+9:14907:x1874182575084416:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787360262.119313:0:17198:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787360262.119342:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787360262.119346:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787360262.119350:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787360262.119354:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787360262.119356:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787360262.122334:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+9:14907:x1874182575084416:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 3039us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.122353:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 125 00000100:00100000:1.0:1787360262.127937:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.141298:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084544 00000100:00100000:2.0:1787360262.141319:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084544 00000100:00100000:2.0:1787360262.141417:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:2.0:1787360262.141431:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3fea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+9:14907:x1874182575084544:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787360262.141462:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360262.141485:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef40d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360262.141521:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360262.141533:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360262.141555:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:2.0:1787360262.141647:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3fea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+10:14907:x1874182575084544:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 218us (13836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360262.141656:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 126 00000100:00100000:1.0:1787360262.150204:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.150351:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084672 00000100:00100000:0.0:1787360262.150364:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084672 00000100:00100000:0.0:1787360262.150423:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:0.0:1787360262.150436:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a0323e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:14907:x1874182575084672:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787360262.150643:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a0323e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:14907:x1874182575084672:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 209us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.150652:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 127 00000100:00100000:3.0:1787360262.153523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.154130:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084800 00000100:00100000:0.0:1787360262.154143:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084800 00000100:00100000:0.0:1787360262.154213:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:0.0:1787360262.154269:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+10:14907:x1874182575084800:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787360262.154475:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+10:14907:x1874182575084800:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 251us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360262.154491:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 128 00000100:00100000:3.0:1787360262.159721:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.160655:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575084928 00000100:00100000:2.0:1787360262.160672:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575084928 00000100:00100000:2.0:1787360262.160752:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:2.0:1787360262.160765:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+10:14931:x1874182575084928:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360262.160977:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+10:14931:x1874182575084928:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 214us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360262.160987:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 129 00000100:00100000:1.0:1787360262.167886:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.168043:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085056 00000100:00100000:3.0:1787360262.168066:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085056 00000100:00100000:3.0:1787360262.168192:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:3.0:1787360262.168206:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:14931:x1874182575085056:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360262.168434:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989041be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:14931:x1874182575085056:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 230us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.168454:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 130 00000100:00100000:2.0:1787360262.189210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.189359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.189671:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085184 00000100:00100000:3.0:1787360262.189684:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085184 00000100:00100000:3.0:1787360262.189735:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085440 00000100:00100000:3.0:1787360262.189738:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085440 00000100:00100000:3.0:1787360262.189768:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360262.189779:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182575085184:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787360262.189815:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d@192.168.206.11@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1787360262.189896:0:17241:0:(genops.c:1385:class_connect()) connect: client 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d, cookie 0x359a4e2aee7215b8 00000004:00100000:3.0:1787360262.189942:0:17241:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787360262.190220:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998a05830000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360262.190355:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2398:x1874182575085184:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 576us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.190380:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360262.190401:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:3.0:1787360262.190407:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1874182575085440:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787360262.190425:0:17241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d@192.168.206.11@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1787360262.191120:0:17241:0:(genops.c:1385:class_connect()) connect: client 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d, cookie 0x359a4e2aee7215bf 00000004:00100000:3.0:1787360262.191150:0:17241:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787360262.191388:0:17241:0:(import.c:65:import_set_state_nolock()) ffff998a05834800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360262.192163:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2398:x1874182575085440:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 1032us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.192179:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:2.0:1787360262.201583:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.201635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360262.201675:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.201805:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085696 00000100:00100000:3.0:1787360262.201818:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085696 00000100:00100000:3.0:1787360262.201898:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085568 00000100:00100000:3.0:1787360262.201902:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085568 00000100:00100000:3.0:1787360262.201920:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085312 00000100:00100000:3.0:1787360262.201922:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085312 00000100:00100000:3.0:1787360262.201939:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1787360262.201951:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:14907:x1874182575085696:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360262.202006:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360262.202119:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:14907:x1874182575085696:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 169us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.202128:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1787360262.202167:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360262.202176:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a37844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:0:x1874182575085568:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360262.202195:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360262.202263:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a37844e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:0:x1874182575085568:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 88us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.202270:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360262.202285:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1787360262.202293:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:0:x1874182575085312:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787360262.202306:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360262.202329:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:0:x1874182575085312:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 39us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.202336:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00080000:2.0:1787360262.203174:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360262.203182:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360262.209915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360262.210077:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085824 00000100:00100000:3.0:1787360262.210090:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085824 00000100:00100000:3.0:1787360262.210181:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:3.0:1787360262.210195:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575085824:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787360262.210353:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575085824:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 161us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.210361:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:0.0:1787360262.219417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.219462:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360262.219561:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.219741:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575085952 00000100:00100000:1.0:1787360262.219755:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575085952 00000100:00100000:1.0:1787360262.219801:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086080 00000100:00100000:1.0:1787360262.219805:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086080 00000100:00100000:1.0:1787360262.219828:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360262.219838:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182575085952:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360262.219882:0:19239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d@192.168.206.11@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1787360262.219925:0:19239:0:(genops.c:1385:class_connect()) connect: client 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d, cookie 0x359a4e2aee7215c6 00002000:00100000:1.0:1787360262.219940:0:19239:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d/ffff9989037d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360262.219989:0:19239:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360262.220206:0:19239:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787360262.220283:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9989037d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360262.220370:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2398:x1874182575085952:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 530us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360262.220379:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360262.220399:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:1.0:1787360262.220404:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1874182575086080:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360262.220423:0:19239:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d@192.168.206.11@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1787360262.220442:0:19239:0:(genops.c:1385:class_connect()) connect: client 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d, cookie 0x359a4e2aee7215cd 00002000:00100000:1.0:1787360262.220448:0:19239:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d/ffff9989037da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360262.220462:0:19239:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360262.220578:0:19239:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360262.220593:0:19239:0:(import.c:65:import_set_state_nolock()) ffff9989037da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360262.220635:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2398:x1874182575086080:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 229us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360262.220641:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787360262.220990:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086208 00000100:00100000:2.0:1787360262.220998:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086208 00000100:00100000:2.0:1787360262.221046:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360262.221065:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575086208:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787360262.221117:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575086208:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 63us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360262.221125:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:0.0:1787360262.226198:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.227787:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086336 00000100:00100000:1.0:1787360262.227807:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086336 00000100:00100000:1.0:1787360262.227893:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:1.0:1787360262.227907:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575086336:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787360262.241266:0:17208:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13167us 00000004:00200000:3.0:1787360262.263750:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787360262.263936:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14907:x1874182575086336:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 36015us (37736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.265139:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1787360262.477154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360262.477264:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086464 00000100:00100000:1.0:1787360262.477278:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086464 00000100:00100000:1.0:1787360262.477373:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:1.0:1787360262.477386:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:14954:x1874182575086464:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:1.0:1787360262.477413:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360262.477446:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681000/0x359a4e2aee7215d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef43e expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477531:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477548:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477566:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360262.477640:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360262.477645:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360262.477689:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477724:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681000/0x359a4e2aee7215d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef43e expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477747:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef43e expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360262.477962:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:1.0:1787360262.477965:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360262.477969:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681e00, rc 0) 00000100:00100000:1.0:1787360262.478049:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:14954:x1874182575086464:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 664us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360262.478077:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00010000:00010000:1.0:1787360262.587588:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360262.905726:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360262.905834:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596141056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787360262.905926:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360262.906126:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141056 00000100:00100000:3.0:1787360262.906138:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141056 00000100:00100000:3.0:1787360262.906261:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360262.906281:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596141056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787360262.906310:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787360262.906361:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596141056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360262.906368:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360262.906511:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596141056:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787360262.906676:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360263.609413:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360263.931588:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360263.931614:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596141184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360263.931681:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360263.933811:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141184 00000100:00100000:2.0:1787360263.933832:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141184 00000100:00100000:2.0:1787360263.933934:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787360263.933953:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596141184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360263.934003:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360263.934141:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596141184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (2459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360263.934169:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787360263.934672:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596141312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360263.934702:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596141184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360263.934753:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360263.937077:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141312 00000100:00100000:3.0:1787360263.937097:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141312 00000100:00100000:3.0:1787360263.937190:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787360263.937203:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596141312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787360263.937271:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787360263.937374:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596141312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360263.937382:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787360263.937684:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596141312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360264.441640:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360264.441747:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.441869:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141440 00000100:00100000:3.0:1787360264.441890:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141440 00000100:00100000:3.0:1787360264.441985:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787360264.441999:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596141440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360264.442034:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787360264.442102:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596141440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.442132:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787360264.442394:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360264.442441:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360264.444709:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360264.444735:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596141568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360264.444824:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360264.445103:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596141824:0@lo:400:kworker.0 00000100:00100000:0.0:1787360264.445141:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360264.445161:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596142336:0@lo:400:kworker.0 00000100:00100000:0.0:1787360264.445182:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360264.445204:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787360264.445209:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596141952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360264.445271:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360264.445288:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596142464:0@lo:400:kworker.0 00000100:00100000:2.0:1787360264.445515:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360264.445526:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596142848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360264.445563:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360264.445600:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141568 00000100:00100000:2.0:1787360264.445608:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141568 00000100:00100000:2.0:1787360264.445661:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142848 00000100:00100000:2.0:1787360264.445664:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142848 00000100:00100000:2.0:1787360264.445690:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360264.445700:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596141568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360264.445736:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360264.445781:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596141568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.445788:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360264.445805:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360264.445812:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596142848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360264.445822:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360264.445848:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596142848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.445854:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787360264.445870:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360264.445909:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596142848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360264.447013:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360264.447091:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141824 00000100:00100000:0.0:1787360264.447098:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141824 00000100:00100000:0.0:1787360264.447142:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142336 00000100:00100000:0.0:1787360264.447146:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142336 00000100:00100000:0.0:1787360264.447169:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142464 00000100:00100000:0.0:1787360264.447172:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142464 00000100:00100000:0.0:1787360264.447189:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787360264.447197:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596141824:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787360264.447435:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360264.447440:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360264.447469:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787360264.447479:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596142336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360264.447525:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1874182596142336:12345-0@lo:400:kworker.0 Request processed in 49us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.447532:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787360264.447550:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360264.447556:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596142464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360264.447582:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596142464:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.447587:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787360264.447633:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35057800 x1874182596142464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360264.447648:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596142464:0@lo:400:kworker.0 00000100:00100000:2.0:1787360264.447663:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3658:1874182596142336:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450385:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596142080:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450480:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.450542:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596142592:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450574:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.450604:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787360264.450611:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596141696:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450646:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.450679:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596142208:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450703:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.450721:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596142720:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450742:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360264.450771:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142592 00000100:00100000:3.0:1787360264.450779:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142592 00000100:00100000:3.0:1787360264.450839:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142208 00000100:00100000:3.0:1787360264.450843:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142208 00000100:00100000:3.0:1787360264.450856:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142720 00000100:00100000:3.0:1787360264.450858:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142720 00000100:00100000:3.0:1787360264.450876:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360264.450886:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596142592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.450949:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1874182596142592:12345-0@lo:400:kworker.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.450956:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360264.450976:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787360264.450984:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596142208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.451034:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596142208:12345-0@lo:400:kworker.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.451040:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787360264.451074:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360264.451082:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596142720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.451129:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596142720:12345-0@lo:400:kworker.0 Request processed in 48us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.451135:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360264.451158:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141696 00000100:00100000:3.0:1787360264.451161:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141696 00000100:00100000:3.0:1787360264.451191:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787360264.451198:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596141696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.451264:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596141696:12345-0@lo:400:kworker.0 Request processed in 66us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.451270:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787360264.451300:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360264.451304:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360264.451336:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596141696:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.451352:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596142208:0@lo:400:kworker.0 00010000:00080000:3.0:1787360264.451364:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35055500 x1874182596142720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360264.451374:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596142720:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.451383:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3660:1874182596142592:0@lo:400:kworker.0 00000100:00100000:0.0:1787360264.451681:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1874182596141824:12345-0@lo:400:kworker.0 Request processed in 4483us (6537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360264.451689:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787360264.451801:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596141952 00000100:00100000:1.0:1787360264.451808:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596141952 00000100:00100000:1.0:1787360264.451865:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142080 00000100:00100000:1.0:1787360264.451869:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142080 00000100:00100000:1.0:1787360264.451893:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360264.451901:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596141952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360264.451943:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596141952:12345-0@lo:400:kworker.0 Request processed in 43us (6672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360264.451950:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360264.451964:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360264.451970:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596142080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360264.452004:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596142080:12345-0@lo:400:kworker.0 Request processed in 34us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360264.452020:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360264.452083:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596142080:0@lo:400:kworker.0 00000100:00100000:1.0:1787360264.452116:0:3661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787360264.452137:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596141568:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787360264.452719:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360264.455037:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596141952:0@lo:400:kworker.0 00000100:00100000:3.0:1787360264.455103:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3658:1874182596141824:0@lo:400:kworker.0 00000100:00100000:0.0:1787360264.558424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360264.566573:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086592 00000100:00100000:3.0:1787360264.566594:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086592 00000100:00100000:3.0:1787360264.566780:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1787360264.566793:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15006:x1874182575086592:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:3.0:1787360264.566833:0:17207:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787360264.566971:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15006:x1874182575086592:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 180us (8559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.566979:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1787360264.570340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360264.570510:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086720 00000100:00100000:1.0:1787360264.570523:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086720 00000100:00080000:0.0:1787360264.570605:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360264.570611:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360264.578779:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:1.0:1787360264.578798:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086720:12345-192.168.206.11@tcp:41:lfs.0 00000004:00000024:1.0:1787360264.578839:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787360264.579488:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086720:12345-192.168.206.11@tcp:41:lfs.0 Request processed in 689us (9156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360264.579499:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:3.0:1787360264.604376:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360264.604569:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086848 00000100:00100000:0.0:1787360264.604583:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086848 00000100:00100000:0.0:1787360264.604698:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:0.0:1787360264.604711:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086848:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:0.0:1787360264.604746:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360264.604850:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086848:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 141us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360264.604858:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00080000:3.0:1787360264.608111:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360264.608942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360264.616252:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575086976 00000100:00100000:1.0:1787360264.616273:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575086976 00000100:00100000:1.0:1787360264.616383:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:1.0:1787360264.616396:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086976:12345-192.168.206.11@tcp:13:lfs.0 00002000:00000024:1.0:1787360264.616429:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787360264.616535:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15006:x1874182575086976:12345-192.168.206.11@tcp:13:lfs.0 Request processed in 141us (7603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360264.616544:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00080000:3.0:1787360264.617318:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787360264.636312:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360264.881545:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360264.881950:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087104 00000100:00100000:3.0:1787360264.881965:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087104 00000100:00100000:3.0:1787360264.882058:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:3.0:1787360264.882071:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+10:15041:x1874182575087104:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360264.882095:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360264.882117:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516600/0x359a4e2aee7215e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef445 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.882154:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516600/0x359a4e2aee7215e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef445 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.882167:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516600/0x359a4e2aee7215e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef445 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.882199:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516600, rc 0) 00000100:00100000:3.0:1787360264.882340:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a4205f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087104:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 271us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.882348:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 132 00000100:00100000:0.0:1787360264.887960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360264.888078:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087232 00000100:00100000:2.0:1787360264.888091:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087232 00000100:00100000:2.0:1787360264.888161:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:2.0:1787360264.888173:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087232:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360264.888424:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087232:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 251us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.888434:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 133 00000100:00100000:1.0:1787360264.911292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360264.911465:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087360 00000100:00100000:0.0:1787360264.911491:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087360 00000100:00100000:0.0:1787360264.911564:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:0.0:1787360264.911577:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087360:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787360264.911770:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087360:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 194us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360264.911779:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 134 00000100:00100000:0.0:1787360264.929026:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360264.930729:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087488 00000100:00100000:3.0:1787360264.930750:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087488 00000100:00100000:3.0:1787360264.930849:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:3.0:1787360264.930862:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087488:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787360264.931076:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087488:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 216us (4855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.931086:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 135 00000100:00100000:3.0:1787360264.963928:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360264.964151:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087616 00000100:00100000:2.0:1787360264.964182:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087616 00000100:00100000:2.0:1787360264.964295:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:2.0:1787360264.964308:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087616:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360264.964487:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087616:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 180us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360264.964496:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 136 00000100:00100000:1.0:1787360264.970572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360264.970748:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087744 00000100:00100000:0.0:1787360264.970761:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087744 00000100:00100000:0.0:1787360264.970846:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1787360264.970858:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087744:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360264.971080:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+11:15045:x1874182575087744:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 223us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360264.971090:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 137 00000100:00100000:0.0:1787360264.981013:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360264.981150:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575087872 00000100:00100000:3.0:1787360264.981161:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575087872 00000100:00100000:3.0:1787360264.981262:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:3.0:1787360264.981274:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+11:15041:x1874182575087872:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787360264.981289:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360264.981304:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517400/0x359a4e2aee7215e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef476 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.981332:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517400/0x359a4e2aee7215e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef476 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.981343:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517400/0x359a4e2aee7215e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef476 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360264.981379:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517400, rc 0) 00000100:00100000:3.0:1787360264.981430:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+12:15041:x1874182575087872:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360264.981437:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 138 00000100:00100000:3.0:1787360264.988490:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360264.988601:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088000 00000100:00100000:2.0:1787360264.988612:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088000 00000100:00100000:2.0:1787360264.988676:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:2.0:1787360264.988688:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+12:15041:x1874182575088000:12345-192.168.206.11@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787360264.988724:0:17199:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787360264.988748:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787360264.988752:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787360264.988755:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787360264.988759:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787360264.988761:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1787360265.000266:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+12:15041:x1874182575088000:12345-192.168.206.11@tcp:256:mount.lustre.0 Request processed in 11536us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360265.000282:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 139 00000100:00100000:0.0:1787360265.004098:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.006057:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088128 00000100:00100000:3.0:1787360265.006077:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088128 00000100:00100000:0.0:1787360265.006563:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:0.0:1787360265.006579:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+12:15041:x1874182575088128:12345-192.168.206.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360265.006603:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360265.006626:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef47d expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360265.006665:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360265.006679:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 13 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360265.006705:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689800, rc 0) 00000100:00100000:0.0:1787360265.006799:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:15041:x1874182575088128:12345-192.168.206.11@tcp:101:mount.lustre.0 Request processed in 223us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.006807:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 140 00000100:00100000:3.0:1787360265.016191:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360265.016420:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088256 00000100:00100000:2.0:1787360265.016435:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088256 00000100:00100000:2.0:1787360265.016504:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:2.0:1787360265.016517:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:15041:x1874182575088256:12345-192.168.206.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360265.016702:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:15041:x1874182575088256:12345-192.168.206.11@tcp:501:mount.lustre.0 Request processed in 187us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360265.016711:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 141 00000100:00100000:1.0:1787360265.022390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360265.022491:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088384 00000100:00100000:0.0:1787360265.022504:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088384 00000100:00100000:0.0:1787360265.022572:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:0.0:1787360265.022718:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:15041:x1874182575088384:12345-192.168.206.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787360265.023295:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:15041:x1874182575088384:12345-192.168.206.11@tcp:503:mount.lustre.0 Request processed in 710us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.023314:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 142 00000100:00100000:0.0:1787360265.031277:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.032136:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088512 00000100:00100000:3.0:1787360265.032153:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088512 00000100:00100000:2.0:1787360265.032291:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:2.0:1787360265.032307:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:15048:x1874182575088512:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360265.032499:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:15048:x1874182575088512:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 196us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360265.032509:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 143 00000100:00100000:2.0:1787360265.053195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.053373:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088640 00000100:00100000:1.0:1787360265.053406:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088640 00000100:00100000:1.0:1787360265.053484:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:1.0:1787360265.053499:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:15048:x1874182575088640:12345-192.168.206.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360265.053717:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:15048:x1874182575088640:12345-192.168.206.11@tcp:502:llog_process_th.0 Request processed in 221us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.053727:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 144 00000100:00100000:1.0:1787360265.065400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.065679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.068931:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088768 00000100:00100000:3.0:1787360265.068954:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088768 00000100:00100000:3.0:1787360265.069292:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089024 00000100:00100000:3.0:1787360265.069299:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089024 00000100:00100000:1.0:1787360265.069399:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360265.069483:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874182575088768:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787360265.069531:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 924bac3c-3aca-4cde-8ca8-f46336646f6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1787360265.069907:0:17205:0:(genops.c:1385:class_connect()) connect: client 924bac3c-3aca-4cde-8ca8-f46336646f6e, cookie 0x359a4e2aee7215f7 00000004:00100000:1.0:1787360265.069944:0:17205:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787360265.070084:0:17205:0:(import.c:65:import_set_state_nolock()) ffff998a3c2b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360265.071102:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2398:x1874182575088768:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 1610us (5707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.071117:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360265.071169:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:1.0:1787360265.071177:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1874182575089024:12345-192.168.206.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787360265.071211:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 924bac3c-3aca-4cde-8ca8-f46336646f6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1787360265.071272:0:17205:0:(genops.c:1385:class_connect()) connect: client 924bac3c-3aca-4cde-8ca8-f46336646f6e, cookie 0x359a4e2aee7215fe 00000004:00100000:1.0:1787360265.071301:0:17205:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787360265.071392:0:17205:0:(import.c:65:import_set_state_nolock()) ffff998a3c2bf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360265.071971:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2398:x1874182575089024:12345-192.168.206.11@tcp:38:mount.lustre.0 Request processed in 789us (6288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.072000:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:3.0:1787360265.077275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.077313:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.077349:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360265.078123:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575088896 00000100:00100000:0.0:1787360265.078139:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575088896 00000100:00100000:0.0:1787360265.078256:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089280 00000100:00100000:0.0:1787360265.078260:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089280 00000100:00100000:0.0:1787360265.078274:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089152 00000100:00100000:0.0:1787360265.078277:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089152 00000100:00100000:0.0:1787360265.078298:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360265.078309:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:0:x1874182575088896:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360265.078357:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360265.078664:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1787360265.078676:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:15041:x1874182575089280:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787360265.078701:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787360265.078790:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:0:x1874182575088896:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 481us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.078799:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360265.078831:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:0.0:1787360265.078839:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:0:x1874182575089152:12345-192.168.206.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360265.078858:0:17241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1787360265.079802:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787360265.079821:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360265.080609:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089280:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 1916us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360265.080623:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360265.084026:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:0:x1874182575089152:12345-192.168.206.11@tcp:41:mount.lustre.0 Request processed in 5171us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.084055:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000040:00080000:0.0:1787360265.088525:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360265.095820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.095959:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089408 00000100:00100000:1.0:1787360265.095973:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089408 00000100:00100000:1.0:1787360265.096095:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360265.096109:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089408:12345-192.168.206.11@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787360265.096426:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089408:12345-192.168.206.11@tcp:40:mount.lustre.0 Request processed in 318us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.096569:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360265.103083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.103191:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360265.113877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.114068:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089792 00000100:00100000:1.0:1787360265.114082:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089792 00000100:00100000:1.0:1787360265.114156:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:1.0:1787360265.114169:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089792:12345-192.168.206.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787360265.114299:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089792:12345-192.168.206.11@tcp:900:mount.lustre.0 Request processed in 132us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.114308:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:0.0:1787360265.115684:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089536 00000100:00100000:0.0:1787360265.115699:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089536 00000100:00100000:0.0:1787360265.115755:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089664 00000100:00100000:0.0:1787360265.115759:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089664 00000100:00100000:0.0:1787360265.115797:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:0.0:1787360265.115807:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1874182575089536:12345-192.168.206.11@tcp:8:mount.lustre.0 00000100:00100000:3.0:1787360265.115941:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787360265.115949:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1874182575089664:12345-192.168.206.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787360265.115999:0:19590:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 924bac3c-3aca-4cde-8ca8-f46336646f6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1787360265.116037:0:19590:0:(genops.c:1385:class_connect()) connect: client 924bac3c-3aca-4cde-8ca8-f46336646f6e, cookie 0x359a4e2aee721605 00002000:00100000:0.0:1787360265.116064:0:19590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 924bac3c-3aca-4cde-8ca8-f46336646f6e/ffff998a2ed98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787360265.116079:0:19590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787360265.116193:0:19590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787360265.116256:0:19590:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360265.116330:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2398:x1874182575089536:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 522us (13261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.116338:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00010000:00080000:0.0:1787360265.120929:0:18714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 924bac3c-3aca-4cde-8ca8-f46336646f6e@192.168.206.11@tcp t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:0.0:1787360265.120978:0:18714:0:(genops.c:1385:class_connect()) connect: client 924bac3c-3aca-4cde-8ca8-f46336646f6e, cookie 0x359a4e2aee72160c 00002000:00100000:0.0:1787360265.120995:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 924bac3c-3aca-4cde-8ca8-f46336646f6e/ffff998a2ed9b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787360265.121013:0:18714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787360265.121136:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787360265.121181:0:18714:0:(import.c:65:import_set_state_nolock()) ffff998a2ed9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360265.121306:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2398:x1874182575089664:12345-192.168.206.11@tcp:8:mount.lustre.0 Request processed in 5353us (18112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360265.121319:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:3.0:1787360265.131603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.131739:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575089920 00000100:00100000:1.0:1787360265.131752:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575089920 00000100:00100000:1.0:1787360265.131814:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:1.0:1787360265.131828:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089920:12345-192.168.206.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787360265.131943:0:17209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787360265.132063:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2eddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15041:x1874182575089920:12345-192.168.206.11@tcp:33:mount.lustre.0 Request processed in 237us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.132071:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:2.0:1787360265.307183:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360265.307347:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090048 00000100:00100000:1.0:1787360265.307361:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090048 00000100:00100000:1.0:1787360265.307437:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1787360265.307450:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15071:x1874182575090048:12345-192.168.206.11@tcp:101:mkdir.0 00010000:00010000:1.0:1787360265.307476:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360265.307501:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee721613 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4ae expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307581:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307597:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307613:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360265.307668:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360265.307672:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360265.307695:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307722:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee721613 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 8 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307743:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360265.307752:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:1.0:1787360265.307754:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360265.307773:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680400, rc 0) 00000100:00100000:1.0:1787360265.307857:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:15071:x1874182575090048:12345-192.168.206.11@tcp:101:mkdir.0 Request processed in 409us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360265.307865:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00010000:00010000:3.0:1787360265.657631:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360266.687651:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787360267.527552:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:1.0:1787360267.527571:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00100000:0.0:1787360267.527812:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:0.0:1787360267.527820:0:17939:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00100000:3.0:1787360267.528855:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:3.0:1787360267.528868:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00000001:00100000:2.0:1787360267.530464:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 924bac3c-3aca-4cde-8ca8-f46336646f6e 00000001:00100000:2.0:1787360267.530474:0:17185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6c5b69-4b93-4276-a9fb-fa611f6ac03d 00010000:00010000:3.0:1787360267.709708:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360268.029936:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360268.029987:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596142976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360268.030128:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360268.030797:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596142976 00000100:00100000:0.0:1787360268.030806:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596142976 00000100:00100000:0.0:1787360268.030870:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787360268.030880:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596142976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360268.030919:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360268.030971:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596142976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360268.030978:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787360268.032889:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360268.033110:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596142976:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787360268.431678:0:20083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787360268.729477:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360269.049624:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596143104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360269.049692:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360269.050494:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143104 00000100:00100000:3.0:1787360269.050511:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143104 00000100:00100000:3.0:1787360269.050601:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360269.050616:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596143104:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360269.050962:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596143232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360269.051048:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360269.051290:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143232 00000100:00100000:2.0:1787360269.051298:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143232 00000004:00000024:3.0:1787360269.051349:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787360269.051354:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787360269.051381:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596143232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360269.051417:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360269.051492:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596143232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360269.051500:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787360269.051540:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596143104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 925us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360269.051558:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890394a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596143232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360269.051563:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360269.061657:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596143104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787360269.563004:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596143360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360269.563114:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360269.563221:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143360 00000100:00100000:2.0:1787360269.563246:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143360 00000100:00100000:2.0:1787360269.563320:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787360269.563332:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596143360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360269.563365:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360269.563407:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890394a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596143360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360269.563414:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787360269.563436:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360269.563476:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596143360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360269.563498:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360269.563517:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596143488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360269.563542:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360269.563565:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143488 00000100:00100000:2.0:1787360269.563569:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143488 00000100:00100000:2.0:1787360269.563594:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787360269.563601:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596143488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360269.563613:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787360269.563646:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596143488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360269.563652:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787360269.563668:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360269.563686:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596143488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360269.564440:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360269.564455:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596143616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787360269.564501:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360269.564549:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143616 00000100:00100000:1.0:1787360269.564554:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143616 00000100:00100000:1.0:1787360269.564594:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787360269.564602:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596143616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787360269.564616:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787360269.564652:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596143616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360269.564659:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787360269.564681:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360269.564843:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596143616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360269.567124:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596144000:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567212:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567278:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596144512:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567318:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567345:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787360269.567351:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596143872:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567375:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567390:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596144384:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567411:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567437:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596144128:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567460:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567478:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596144640:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567499:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567524:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787360269.567530:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596143744:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567562:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567591:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596144256:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567612:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360269.567636:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144512 00000100:00100000:0.0:1787360269.567645:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144512 00000100:00100000:0.0:1787360269.567699:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143872 00000100:00100000:0.0:1787360269.567717:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143872 00000100:00100000:0.0:1787360269.567746:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144384 00000100:00100000:0.0:1787360269.567749:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144384 00000100:00100000:0.0:1787360269.567762:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144128 00000100:00100000:0.0:1787360269.567764:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144128 00000100:00100000:0.0:1787360269.567773:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144640 00000100:00100000:0.0:1787360269.567776:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144640 00000100:00100000:0.0:1787360269.567786:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144256 00000100:00100000:0.0:1787360269.567789:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144256 00000100:00100000:0.0:1787360269.567805:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360269.567815:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596144512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567874:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1874182596144512:12345-0@lo:400:kworker.0 Request processed in 60us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.567882:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787360269.567903:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787360269.567909:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596143872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567937:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596143872:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.567943:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787360269.567954:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787360269.567960:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596144384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.567987:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1874182596144384:12345-0@lo:400:kworker.0 Request processed in 28us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.567993:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787360269.568005:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787360269.568010:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568055:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596144128:12345-0@lo:400:kworker.0 Request processed in 45us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.568072:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787360269.568085:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787360269.568091:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596144640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568120:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596144640:12345-0@lo:400:kworker.0 Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.568126:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787360269.568139:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787360269.568146:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568172:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596144256:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.568178:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787360269.568198:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596143744 00000100:00100000:0.0:1787360269.568203:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596143744 00000100:00100000:0.0:1787360269.568252:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787360269.568260:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596143744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568291:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3660:x1874182596143744:12345-0@lo:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360269.568297:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787360269.568342:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596143744:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568355:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596144256:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568364:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596144128:0@lo:400:kworker.0 00010000:00080000:0.0:1787360269.568374:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35054380 x1874182596144640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360269.568397:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596144640:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568437:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596143872:0@lo:400:kworker.0 00010000:00080000:0.0:1787360269.568447:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff998a35055880 x1874182596144384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360269.568456:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3659:1874182596144384:0@lo:400:kworker.0 00000100:00100000:0.0:1787360269.568464:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3659:1874182596144512:0@lo:400:kworker.0 00000100:00100000:2.0:1787360269.568733:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596144000 00000100:00100000:2.0:1787360269.568745:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596144000 00000100:00100000:2.0:1787360269.568785:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360269.568793:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596144000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360269.568847:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a35055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596144000:12345-0@lo:400:kworker.0 Request processed in 56us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360269.568854:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360269.568893:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a35055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596144000:0@lo:400:kworker.0 00000100:00080000:1.0:1787360269.570666:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787360269.570679:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787360269.755038:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360270.191450:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191535:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191629:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191650:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191676:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360270.191723:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090304 00000100:00100000:2.0:1787360270.191736:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090304 00000100:00100000:2.0:1787360270.191819:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090816 00000100:00100000:2.0:1787360270.191822:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090816 00000100:00100000:2.0:1787360270.191840:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090432 00000100:00100000:2.0:1787360270.191842:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090432 00000100:00100000:2.0:1787360270.191858:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090944 00000100:00100000:2.0:1787360270.191860:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090944 00000100:00100000:2.0:1787360270.191878:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:2.0:1787360270.191889:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2401:x1874182575090304:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.191991:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2401:x1874182575090304:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 94us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192029:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:2.0:1787360270.192048:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1787360270.192055:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575090816:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192085:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575090816:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192091:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:2.0:1787360270.192103:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360270.192109:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192136:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192142:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:2.0:1787360270.192155:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:2.0:1787360270.192162:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575090944:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192207:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575090944:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 45us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192215:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:2.0:1787360270.192268:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090560 00000100:00100000:2.0:1787360270.192273:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090560 00000100:00100000:2.0:1787360270.192314:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091072 00000100:00100000:2.0:1787360270.192318:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091072 00000100:00100000:2.0:1787360270.192330:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090688 00000100:00100000:2.0:1787360270.192332:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090688 00000100:00100000:2.0:1787360270.192343:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091200 00000100:00100000:2.0:1787360270.192345:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091200 00000100:00100000:2.0:1787360270.192360:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360270.192373:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090560:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192402:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090560:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 29us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192408:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:2.0:1787360270.192421:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360270.192427:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575091072:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192450:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575091072:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192456:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:2.0:1787360270.192467:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360270.192473:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090688:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192495:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575090688:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192500:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 12 00000100:00100000:2.0:1787360270.192510:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:2.0:1787360270.192515:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575091200:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192536:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575091200:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 20us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192542:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:2.0:1787360270.192563:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575090176 00000100:00100000:2.0:1787360270.192567:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575090176 00000100:00100000:2.0:1787360270.192597:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00100000:2.0:1787360270.192604:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:2401:x1874182575090176:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360270.192636:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ef72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:2401:x1874182575090176:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 33us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360270.192643:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 146 00000100:00080000:2.0:1787360270.192692:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360270.192696:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787360270.192699:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787360270.192701:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787360270.777806:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360271.805274:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787360271.929801:0:20231:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1d316220 20000000:00000080:2.0:1787360271.929816:0:20231:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff998a3c335800 uarg=0000000000000000 20000000:01000000:2.0:1787360271.929859:0:20231:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787360271.929864:0:20231:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787360271.929869:0:20231:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787360271.930697:0:20232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787360271.930830:0:20231:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787360271.940839:0:20231:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787360271.940995:0:20231:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941031:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941040:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941047:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941053:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721396 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941061:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941085:0:20231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941093:0:20231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941135:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 12 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941150:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 12 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.941163:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596144768:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360271.941276:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941284:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 12 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.941295:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596144896:192.168.206.11@tcp:104: 00010000:00010000:2.0:1787360271.941329:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941339:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 23 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.941351:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145024:0@lo:104: 00000100:00100000:2.0:1787360271.941390:0:20231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360271.941449:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.941457:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 23 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.941465:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145152:0@lo:104: 00000100:00100000:0.0:1787360271.943081:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145024 00000100:00100000:0.0:1787360271.943099:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145024 00000100:00100000:0.0:1787360271.943172:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787360271.943185:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145024:12345-0@lo:104: 00010000:00010000:0.0:1787360271.943206:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.943344:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360271.943351:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145024:12345-0@lo:104: Request processed in 169us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360271.943360:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787360271.943391:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360271.943399:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.943407:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a8400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:0.0:1787360271.943427:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.943437:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360271.943446:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360271.943453:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787360271.945928:0:20231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360271.946069:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145152 00000100:00100000:1.0:1787360271.946085:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145152 00010000:00010000:0.0:1787360271.946116:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.946133:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787360271.946139:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360271.946154:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145152:12345-0@lo:104: 00010000:00010000:0.0:1787360271.946171:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.946182:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a8400/0x359a4e2aee721396 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee72139d expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946201:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.946207:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360271.946211:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360271.946216:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360271.946265:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596145280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360271.946322:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.946335:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 23 pid: 17198 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.946349:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145408:0@lo:104: 00000100:00100000:0.0:1787360271.946356:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360271.946384:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787360271.946392:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145152:12345-0@lo:104: Request processed in 242us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360271.946398:0:20231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360271.946403:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360271.946420:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145408 00000100:00100000:1.0:1787360271.946423:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145408 00000100:00100000:1.0:1787360271.946437:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360271.946442:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145408:12345-0@lo:104: 00010000:00010000:2.0:1787360271.946443:0:20231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946449:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360271.946459:0:20231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.946468:0:20231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145536:0@lo:104: 00010000:00010000:1.0:1787360271.946479:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787360271.946484:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145408:12345-0@lo:104: Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360271.946490:0:20231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360271.946490:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360271.946500:0:20231:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b98fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360271.946500:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145536 00000100:00100000:1.0:1787360271.946509:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145536 00000100:00100000:2.0:1787360271.946520:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145024:0@lo:104: 00000100:00100000:1.0:1787360271.946524:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360271.946528:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145152:0@lo:104: 00000100:00100000:1.0:1787360271.946529:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145536:12345-0@lo:104: 00000100:00100000:2.0:1787360271.946535:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145408:0@lo:104: 00010000:00010000:1.0:1787360271.946536:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946570:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787360271.946575:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+3:20231:x1874182596145536:12345-0@lo:104: Request processed in 47us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360271.946581:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787360271.946597:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787360271.946602:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360271.946607:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596145536:0@lo:104: 00010000:00010000:1.0:1787360271.946610:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caee800 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360271.946613:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946622:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360271.946629:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360271.946635:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360271.946681:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946688:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787360271.946691:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145280 00000100:00100000:0.0:1787360271.946700:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145280 00010000:00010000:1.0:1787360271.946712:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946728:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caee800/0x359a4e2aee7212fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee721303 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946742:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360271.946745:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946751:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a3caeea00 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360271.946754:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946761:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360271.946768:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360271.946773:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360271.946810:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946816:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360271.946823:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946829:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a3caeea00/0x359a4e2aee7212bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212c4 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946837:0:17194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360271.946850:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946856:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a067a9400 already unused, calling callback (ffffffffc14bfc20) 10000000:00010000:1.0:1787360271.946858:0:17194:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946865:0:17194:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360271.946870:0:17194:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360271.946875:0:17194:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787360271.946888:0:17194:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946894:0:17194:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360271.946908:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946914:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.111@tcp lock: ffff998a067a9400/0x359a4e2aee7212af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x359a4e2aee7212b6 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.946929:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360271.946931:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360271.946932:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360271.946944:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596145664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360271.946985:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360271.947017:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787360271.947023:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596145792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360271.947053:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360271.947081:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145664 00000100:00100000:1.0:1787360271.947086:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145664 00010000:00010000:1.0:1787360271.947103:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 25 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.947118:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145792 00000100:00100000:1.0:1787360271.947121:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145792 00010000:00010000:1.0:1787360271.947130:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 26 pid: 17198 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.947141:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360271.947148:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+26:3658:x1874182596145664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360271.947158:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 26 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947159:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360271.947171:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 26 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947184:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 26 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360271.947193:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787360271.947199:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b71600/0x359a4e2aee721303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7212fc expref: 26 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947212:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360271.947218:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787360271.947273:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596145920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360271.947280:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+25:3658:x1874182596145664:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360271.947291:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360271.947313:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360271.947321:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3658:x1874182596145792:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360271.947333:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360271.947351:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360271.947357:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 24 pid: 17198 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947366:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 24 pid: 17198 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947377:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70000/0x359a4e2aee7212c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7212bd expref: 24 pid: 17198 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360271.947381:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787360271.947387:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360271.947391:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596145920 00000100:00100000:0.0:1787360271.947397:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596145920 00010000:00010000:0.0:1787360271.947419:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 24 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.947430:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3658:x1874182596145792:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360271.947442:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360271.947456:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360271.947465:0:17192:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787360271.947472:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:3661:x1874182596145280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360271.947482:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787360271.947490:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787360271.947495:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:3660:x1874182596145920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360271.947505:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360271.947509:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947517:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947526:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70600/0x359a4e2aee7212b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee7212af expref: 23 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.947534:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360271.947563:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:3660:x1874182596145920:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360271.947576:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360271.947611:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596145792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360271.947619:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596145664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360271.947729:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 21 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.947743:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 21 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.947765:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70c00/0x359a4e2aee72139d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x359a4e2aee721396 expref: 21 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.947781:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360271.947962:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:3661:x1874182596145280:12345-0@lo:103:ldlm_bl.0 Request processed in 494us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360271.947970:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360271.948072:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3661:1874182596145280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360271.948137:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3660:1874182596145920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360271.948160:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360271.949572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360271.949608:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360271.949650:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596144768:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360271.949927:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091456 00000100:00100000:1.0:1787360271.949936:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091456 00010000:00010000:1.0:1787360271.949982:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 13 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.950023:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091328 00000100:00100000:1.0:1787360271.950027:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091328 00010000:00010000:1.0:1787360271.950040:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 14 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.950055:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 13 00000100:00100000:1.0:1787360271.950062:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a227f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14e95e5c-9854-457b-a93b-73582689ff25+14:2400:x1874182575091456:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360271.950075:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360271.950080:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 14 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.950089:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 14 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360271.950108:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360271.951052:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787360271.951068:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 14 00000100:00100000:3.0:1787360271.951084:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+14:2399:x1874182575091328:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360271.951095:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360271.951101:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 14 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951113:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 14 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951125:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998a01689800/0x359a4e2aee7215f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef47d expref: 14 pid: 17197 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951160:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951168:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951182:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951188:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951195:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951202:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951208:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b70200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360271.951212:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951220:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951249:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360271.951261:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360271.951310:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14e95e5c-9854-457b-a93b-73582689ff25+13:2399:x1874182575091328:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 232us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360271.951323:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 14 00010000:00010000:0.0:1787360271.951971:0:20231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70800/0x359a4e2aee7215b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef40d expref: 12 pid: 17199 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360271.952016:0:20231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a2ee5fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20231:1874182596144896:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360271.952070:0:20231:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.952081:0:20231:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.952087:0:20231:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360271.952094:0:20231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff998903b70200/0x359a4e2aee721621 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360271.952490:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a227f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:14e95e5c-9854-457b-a93b-73582689ff25+11:2400:x1874182575091456:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 2422us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360271.952510:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 13 00000040:00080000:3.0:1787360272.250339:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360272.827212:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360273.148438:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596146048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787360273.149105:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360273.149176:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146048 00000100:00100000:0.0:1787360273.149185:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146048 00000100:00100000:0.0:1787360273.149258:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360273.149269:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596146048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787360273.149304:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360273.149353:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596146048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.149360:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787360273.149379:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360273.150812:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596146048:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787360273.470939:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787360273.471025:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998903b0b000 from 13 10000000:01000000:1.0:1787360273.471030:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360273.471073:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360273.471086:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360273.471098:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360273.471122:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787360273.471186:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360273.472271:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff9989036c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360273.475870:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146176 00000100:00100000:2.0:1787360273.475883:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146176 00000100:00100000:3.0:1787360273.481342:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787360273.481357:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+20:17202:x1874182596146176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.481374:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360273.481395:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01517e00/0x359a4e2aee72162f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721628 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.481421:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01517e00/0x359a4e2aee72162f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721628 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.481431:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01517e00/0x359a4e2aee72162f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721628 expref: 21 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.481439:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01517e00, rc 0) 00000100:00100000:3.0:1787360273.481524:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a03225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (10337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.481530:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787360273.481582:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.481600:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.481610:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.481689:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.481741:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.482023:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.482040:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146304 00000100:00100000:3.0:1787360273.482047:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146304 00000100:00100000:3.0:1787360273.482078:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787360273.482086:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.482200:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.482208:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787360273.482261:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.482291:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.482330:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.482344:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.482354:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146432 00000100:00100000:3.0:1787360273.482357:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146432 00000100:00100000:3.0:1787360273.482374:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787360273.482379:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.482450:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.482457:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787360273.482643:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787360273.483522:0:20305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360273.483580:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360273.483596:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360273.483605:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.483623:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a06681000/0x359a4e2aee721628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72162f expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360273.483632:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360273.483635:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a042ae800 from 13 10000000:01000000:3.0:1787360273.483638:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360273.483664:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.483671:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.483680:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.483697:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.483736:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360273.484029:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146560 00000100:00100000:2.0:1787360273.484036:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146560 00000100:00100000:2.0:1787360273.484070:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787360273.484077:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+21:17202:x1874182596146560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360273.484087:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360273.484099:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b70a00/0x359a4e2aee72163d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721636 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.484117:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b70a00/0x359a4e2aee72163d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721636 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.484127:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b70a00/0x359a4e2aee72163d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721636 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.484134:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70a00, rc 0) 00000100:00100000:2.0:1787360273.484166:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360273.484172:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787360273.485424:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.485450:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.485466:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.485476:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.485874:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.485918:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.486032:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.486055:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146688 00000100:00100000:3.0:1787360273.486061:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146688 00000100:00100000:3.0:1787360273.486100:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787360273.486108:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.486216:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.486243:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787360273.491168:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.491242:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.491313:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.491349:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ef1c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.491369:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146816 00000100:00100000:3.0:1787360273.491375:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146816 00000100:00100000:3.0:1787360273.491425:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787360273.491435:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.491531:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.491539:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787360273.491583:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787360273.492568:0:20306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360273.492622:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360273.492640:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360273.492649:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.492672:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01516200/0x359a4e2aee721636 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72163d expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360273.492683:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360273.492685:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9989029fe800 from 13 10000000:01000000:3.0:1787360273.492688:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360273.492713:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.492721:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.492730:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.492745:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.494154:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.494198:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360273.496418:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596146944 00000100:00100000:2.0:1787360273.496431:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596146944 00000100:00100000:2.0:1787360273.497173:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787360273.497185:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+22:17202:x1874182596146944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360273.497199:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360273.497215:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998903b71200/0x359a4e2aee72164b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721644 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.497269:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998903b71200/0x359a4e2aee72164b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721644 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.497280:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998903b71200/0x359a4e2aee72164b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721644 expref: 23 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360273.497289:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b71200, rc 0) 00000100:00100000:2.0:1787360273.497354:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596146944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (3203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360273.497360:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787360273.497570:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596146944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.497587:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.497595:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.497909:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.497945:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.497983:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.498010:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147072 00000100:00100000:3.0:1787360273.498016:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147072 00000100:00100000:3.0:1787360273.498054:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787360273.498061:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596147072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.498162:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596147072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.498170:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787360273.498205:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.498250:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.498289:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.498302:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.498314:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147200 00000100:00100000:3.0:1787360273.498318:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147200 00000100:00100000:3.0:1787360273.498342:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787360273.498348:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596147200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.498420:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596147200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.498427:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787360273.498465:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787360273.505153:0:20308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360273.505265:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360273.505286:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360273.505298:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.505321:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01517c00/0x359a4e2aee721644 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee72164b expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360273.505331:0:17202:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360273.505334:0:17202:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff998a3d61f800 from 13 10000000:01000000:3.0:1787360273.505336:0:17202:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360273.505370:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.505378:0:17202:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.505389:0:17202:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.505412:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.505473:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360273.506298:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147328 00000100:00100000:0.0:1787360273.506313:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147328 00000100:00100000:0.0:1787360273.506360:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787360273.506369:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+23:17202:x1874182596147328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360273.506383:0:17197:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360273.506397:0:17197:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688600/0x359a4e2aee721659 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x359a4e2aee721652 expref: -99 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.506421:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688600/0x359a4e2aee721659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x359a4e2aee721652 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.506432:0:17197:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688600/0x359a4e2aee721659 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x359a4e2aee721652 expref: 24 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.506441:0:17197:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688600, rc 0) 00000100:00100000:0.0:1787360273.515948:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596147328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 9570us (10464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.515960:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787360273.516849:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.516882:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.516905:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.516916:0:17202:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.517006:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.517049:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.517083:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.517104:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147456 00000100:00100000:3.0:1787360273.517109:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147456 00000100:00100000:3.0:1787360273.517151:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787360273.517161:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596147456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.517311:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596147456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.517318:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787360273.517352:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.517378:0:17202:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.517418:0:17202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360273.517433:0:17202:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360273.517446:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147584 00000100:00100000:3.0:1787360273.517449:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147584 00000100:00100000:3.0:1787360273.517474:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787360273.517481:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596147584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.517931:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:17202:x1874182596147584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 449us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.517938:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787360273.519944:0:17202:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9b5a46b1-7024-40db-b9fb-69c8c09a9227:17202:1874182596147584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787360273.520611:0:20309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787360273.520676:0:17202:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787360273.520698:0:17202:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360273.520708:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.520730:0:17202:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.111@tcp lock: ffff998a01516a00/0x359a4e2aee721652 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x359a4e2aee721659 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360273.577668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360273.578029:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091584 00000100:00100000:0.0:1787360273.578039:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091584 00000100:00100000:0.0:1787360273.578096:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:0.0:1787360273.578106:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+11:14922:x1874182575091584:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360273.578121:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360273.578137:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01688000/0x359a4e2aee721660 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4b5 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.578163:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01688000/0x359a4e2aee721660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4b5 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.578173:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01688000/0x359a4e2aee721660 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4b5 expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360273.578195:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688000, rc 0) 00000100:00100000:0.0:1787360273.578284:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091584:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 179us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.578291:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 159 00000100:00100000:1.0:1787360273.595763:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360273.595860:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091712 00000100:00100000:0.0:1787360273.595870:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091712 00000100:00100000:0.0:1787360273.595921:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:0.0:1787360273.595931:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091712:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360273.596090:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091712:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 159us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.596098:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 160 00000100:00100000:1.0:1787360273.600605:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360273.600990:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091840 00000100:00100000:3.0:1787360273.601010:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091840 00000100:00100000:3.0:1787360273.601079:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:3.0:1787360273.601091:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091840:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360273.601263:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a02ef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091840:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 174us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.601271:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 161 00000100:00100000:1.0:1787360273.618129:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360273.618287:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575091968 00000100:00100000:3.0:1787360273.618296:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575091968 00000100:00100000:3.0:1787360273.618364:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:3.0:1787360273.618376:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+12:14922:x1874182575091968:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360273.618393:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360273.618411:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff998a01516000/0x359a4e2aee721667 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4bc expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.618437:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff998a01516000/0x359a4e2aee721667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4bc expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.618448:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff998a01516000/0x359a4e2aee721667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4bc expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360273.618457:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01516000, rc 0) 00000100:00100000:3.0:1787360273.618539:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+13:14922:x1874182575091968:12345-192.168.206.11@tcp:101:ll_cfg_requeue.0 Request processed in 164us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360273.618546:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 162 00000100:00100000:1.0:1787360273.627412:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360273.627500:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092096 00000100:00100000:0.0:1787360273.627509:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092096 00000100:00100000:0.0:1787360273.627562:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:0.0:1787360273.627572:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:14922:x1874182575092096:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360273.627720:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:14922:x1874182575092096:12345-192.168.206.11@tcp:501:ll_cfg_requeue.0 Request processed in 147us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.627729:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 163 00000100:00100000:1.0:1787360273.633833:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360273.633920:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092224 00000100:00100000:0.0:1787360273.633930:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092224 00000100:00100000:0.0:1787360273.633986:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 164 00000100:00100000:0.0:1787360273.634005:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:14922:x1874182575092224:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787360273.634153:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:14e95e5c-9854-457b-a93b-73582689ff25+13:14922:x1874182575092224:12345-192.168.206.11@tcp:503:ll_cfg_requeue.0 Request processed in 158us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360273.634169:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 164 00010000:00010000:0.0:1787360273.851653:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360274.169561:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360274.169582:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596147712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360274.169647:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360274.169787:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147712 00000100:00100000:2.0:1787360274.169795:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147712 00000100:00100000:2.0:1787360274.169843:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787360274.169853:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596147712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360274.169887:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787360274.169943:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596147712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360274.169950:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787360274.170038:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596147712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360274.170239:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596147840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360274.170265:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.170327:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147840 00000100:00100000:0.0:1787360274.170331:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147840 00000100:00100000:0.0:1787360274.170360:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787360274.170366:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596147840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360274.170384:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360274.170422:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1874182596147840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360274.170428:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787360274.170494:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3659:1874182596147840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787360274.683571:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360274.683636:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.683680:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360274.683687:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360274.683711:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.683743:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596147968 00000100:00100000:0.0:1787360274.683750:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596147968 00000100:00100000:0.0:1787360274.683793:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148096 00000100:00100000:0.0:1787360274.683796:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148096 00000100:00100000:0.0:1787360274.683814:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360274.683822:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596147968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360274.683841:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787360274.683893:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596147968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360274.683900:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787360274.683928:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360274.683934:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596148096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360274.683951:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360274.683979:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596148096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360274.683985:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787360274.684011:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360274.684015:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360274.684043:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360274.684055:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a037a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360274.685465:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596148224:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685520:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360274.685603:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596148352:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685633:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360274.685666:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148352 00000100:00100000:1.0:1787360274.685672:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148352 00000100:00100000:1.0:1787360274.685709:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787360274.685717:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685763:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1874182596148352:12345-0@lo:400:kworker.0 Request processed in 47us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360274.685780:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787360274.685821:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3659:1874182596148352:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685875:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596148736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685899:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360274.685940:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596148864:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.685962:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360274.686029:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596149248:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686056:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360274.686081:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148736 00000100:00100000:1.0:1787360274.686085:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148736 00000100:00100000:1.0:1787360274.686099:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148864 00000100:00100000:1.0:1787360274.686101:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148864 00000100:00100000:1.0:1787360274.686119:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596149248 00000100:00100000:1.0:1787360274.686122:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596149248 00000100:00100000:1.0:1787360274.686135:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360274.686141:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686173:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1874182596148736:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360274.686179:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360274.686191:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787360274.686197:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596148864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686221:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1874182596148864:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360274.686255:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787360274.686267:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787360274.686281:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596149248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686310:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1874182596149248:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360274.686315:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787360274.686344:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890415aa00 x1874182596149248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360274.686354:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3658:1874182596149248:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686363:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3658:1874182596148736:0@lo:400:kworker.0 00000100:00100000:1.0:1787360274.686386:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3659:1874182596148864:0@lo:400:kworker.0 00000100:00100000:3.0:1787360274.686787:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148224 00000100:00100000:3.0:1787360274.686792:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148224 00000100:00100000:3.0:1787360274.686837:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787360274.686845:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3658:x1874182596148224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360274.686891:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3658:x1874182596148224:12345-0@lo:400:kworker.0 Request processed in 47us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360274.686898:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787360274.686936:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3658:1874182596148224:0@lo:400:kworker.0 00000100:00100000:0.0:1787360274.687693:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596148608:0@lo:400:kworker.0 00000100:00100000:0.0:1787360274.687732:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.687756:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596149120:0@lo:400:kworker.0 00000100:00100000:0.0:1787360274.687779:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.687797:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787360274.687804:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596148480:0@lo:400:kworker.0 00000100:00100000:0.0:1787360274.687826:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360274.687843:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596148992:0@lo:400:kworker.0 00000100:00100000:0.0:1787360274.687875:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787360274.687899:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360274.687904:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360274.687968:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148608 00000100:00100000:2.0:1787360274.687974:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148608 00000100:00100000:2.0:1787360274.688032:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148480 00000100:00100000:2.0:1787360274.688035:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148480 00000100:00100000:2.0:1787360274.688054:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360274.688061:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596148608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360274.688106:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596148608:12345-0@lo:400:kworker.0 Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360274.688113:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360274.688140:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360274.688146:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596148480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360274.688176:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1874182596148480:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360274.688181:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360274.688217:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596148480:0@lo:400:kworker.0 00000100:00100000:2.0:1787360274.688251:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3661:1874182596148608:0@lo:400:kworker.0 00000100:00100000:2.0:1787360274.688273:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596149376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787360274.688298:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360274.688327:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596149376 00000100:00100000:2.0:1787360274.688330:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596149376 00000100:00100000:2.0:1787360274.688352:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360274.688359:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596149376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787360274.688372:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787360274.688407:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596149376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360274.688413:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360274.688445:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596149376:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787360274.688932:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360274.688988:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596149120 00000100:00100000:3.0:1787360274.689003:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596149120 00000100:00100000:3.0:1787360274.689056:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596148992 00000100:00100000:3.0:1787360274.689060:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596148992 00000100:00100000:3.0:1787360274.689085:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787360274.689093:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360274.689135:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1874182596149120:12345-0@lo:400:kworker.0 Request processed in 43us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360274.689141:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787360274.689164:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787360274.689172:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596148992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360274.689203:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1874182596148992:12345-0@lo:400:kworker.0 Request processed in 33us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360274.689209:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787360274.689301:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787360274.689305:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787360274.694938:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890415b800 x1874182596148992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360274.694957:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3661:1874182596148992:0@lo:400:kworker.0 00000100:00100000:2.0:1787360274.694972:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890415ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3661:1874182596149120:0@lo:400:kworker.0 00010000:00010000:1.0:1787360274.873438:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360275.321890:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787360275.327899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.327947:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.327974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.328020:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.328041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.328163:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092608 00000100:00100000:3.0:1787360275.328173:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092608 00000100:00100000:3.0:1787360275.328264:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093120 00000100:00100000:3.0:1787360275.328268:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093120 00000100:00100000:3.0:1787360275.328301:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360275.328312:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2399:x1874182575092608:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360275.328399:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2399:x1874182575092608:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360275.328406:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360275.328424:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1787360275.328433:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2399:x1874182575093120:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360275.328455:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2399:x1874182575093120:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360275.328461:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:2.0:1787360275.328972:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092864 00000100:00100000:2.0:1787360275.328977:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092864 00000100:00100000:2.0:1787360275.329038:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093376 00000100:00100000:2.0:1787360275.329041:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093376 00000100:00100000:2.0:1787360275.329061:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:2.0:1787360275.329067:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2399:x1874182575092864:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360275.329103:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2399:x1874182575092864:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 37us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360275.329109:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:2.0:1787360275.329119:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:2.0:1787360275.329124:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2399:x1874182575093376:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360275.329145:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2399:x1874182575093376:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 21us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360275.329150:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00080000:1.0:1787360275.329544:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360275.329550:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360275.329624:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092352 00000100:00100000:0.0:1787360275.329647:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092352 00000100:00100000:0.0:1787360275.329693:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:0.0:1787360275.329700:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:2399:x1874182575092352:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:0.0:1787360275.329745:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:14e95e5c-9854-457b-a93b-73582689ff25+13:2399:x1874182575092352:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 46us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360275.329752:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 166 00000100:00100000:3.0:1787360275.332248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.332290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.332315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360275.332411:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092736 00000100:00100000:2.0:1787360275.332419:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092736 00000100:00100000:2.0:1787360275.332471:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:2.0:1787360275.332492:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2400:x1874182575092736:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360275.332547:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2400:x1874182575092736:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360275.332554:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:3.0:1787360275.333030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00080000:3.0:1787360275.333073:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360275.333205:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093248 00000100:00100000:2.0:1787360275.333210:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093248 00000100:00100000:2.0:1787360275.333275:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:2.0:1787360275.333284:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2400:x1874182575093248:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360275.333323:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2400:x1874182575093248:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 41us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360275.333361:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00080000:3.0:1787360275.337888:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360275.338719:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092480 00000100:00100000:1.0:1787360275.338733:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092480 00000100:00100000:1.0:1787360275.338801:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575092992 00000100:00100000:1.0:1787360275.338805:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575092992 00000100:00100000:1.0:1787360275.338838:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1787360275.338848:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2400:x1874182575092480:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360275.338928:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2400:x1874182575092480:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 82us (6710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.338936:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1787360275.338968:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1787360275.338975:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2400:x1874182575092992:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:3.0:1787360275.339264:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360275.339816:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2400:x1874182575092992:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 839us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.339825:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:2.0:1787360275.596457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.596892:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093504 00000100:00100000:3.0:1787360275.596915:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093504 00000100:00100000:3.0:1787360275.596979:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360275.597002:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:15587:x1874182575093504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360275.597022:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360275.597045:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72166e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4c3 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597106:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597118:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597130:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597144:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597151:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597158:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597265:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597273:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597279:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360275.597322:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360275.597326:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360275.597362:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597373:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597380:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597387:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597392:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360275.597396:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597403:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597415:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:3.0:1787360275.597418:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.597423:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597429:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597443:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597458:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597464:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597468:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360275.597472:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597478:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597487:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff998a28ed0000) 00010000:00010000:3.0:1787360275.597490:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.597492:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597498:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee72167c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597529:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72166e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4c3 expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597541:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040000/0x359a4e2aee721683 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4c3 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.597548:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998a28ed0a00) 00010000:00010000:3.0:1787360275.597550:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360275.597559:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040000, rc 0) 00000100:00100000:3.0:1787360275.597627:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15587:x1874182575093504:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 638us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360275.597644:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00100000:3.0:1787360275.607681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.608631:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093632 00000100:00100000:1.0:1787360275.608642:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093632 00000100:00100000:1.0:1787360275.608702:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1787360275.608712:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15587:x1874182575093632:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787360275.608793:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15587:x1874182575093632:12345-192.168.206.11@tcp:900:lhsmtool_posix.0 Request processed in 83us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.608801:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:2.0:1787360275.612328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.612416:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575093888 00000100:00100000:3.0:1787360275.612426:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575093888 00000100:00100000:3.0:1787360275.612496:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:3.0:1787360275.612508:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:15587:x1874182575093888:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360275.612526:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360275.612546:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72168a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4ca expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612613:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612626:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612649:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612664:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612671:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612678:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612796:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041600/0x359a4e2aee72169f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612804:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041600/0x359a4e2aee72169f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612811:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041600/0x359a4e2aee72169f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360275.612820:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787360275.612948:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612956:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612962:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612968:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360275.612972:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.612978:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613003:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff998a28ed0a00) 00010000:00010000:3.0:1787360275.613006:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.613010:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613025:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee721691 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613039:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613045:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613050:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613054:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360275.613057:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613063:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613071:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff998a28ed0000) 00010000:00010000:3.0:1787360275.613074:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.613077:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.613083:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee721698 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.614029:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72168a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ca expref: 10 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.614058:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041600/0x359a4e2aee72169f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ca expref: 9 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.614065:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a28ed0400) 00010000:00010000:3.0:1787360275.614068:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.614070:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041600, rc 0) 00000100:00100000:3.0:1787360275.614130:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15587:x1874182575093888:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1625us (1810us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787360275.614138:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360275.624053:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.624146:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094016 00000100:00100000:1.0:1787360275.624156:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094016 00000100:00100000:1.0:1787360275.624211:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1787360275.624222:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15587:x1874182575094016:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787360275.624354:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15587:x1874182575094016:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 134us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.624362:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:1.0:1787360275.633648:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360275.634201:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094144 00000100:00100000:0.0:1787360275.634212:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094144 00000100:00100000:0.0:1787360275.634306:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:0.0:1787360275.634317:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15587:x1874182575094144:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787360275.639673:0:17206:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5314us 00000100:00100000:3.0:1787360275.678157:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15587:x1874182575094144:12345-192.168.206.11@tcp:59:lhsmtool_posix.0 Request processed in 43830us (44506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360275.678173:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:2.0:1787360275.729067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.729171:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094272 00000100:00100000:1.0:1787360275.729181:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094272 00000100:00100000:1.0:1787360275.729276:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:1.0:1787360275.729287:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15593:x1874182575094272:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360275.729309:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360275.729343:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee7216ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4d1 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729401:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729414:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729425:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729440:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729447:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729453:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729508:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729515:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729521:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729527:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360275.729530:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729548:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729560:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:1.0:1787360275.729563:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360275.729568:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729574:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729588:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729593:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729598:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729604:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360275.729606:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729613:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729620:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed4a00) 00010000:00010000:1.0:1787360275.729622:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360275.729625:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729647:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729678:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee7216ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4d1 expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729687:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:1.0:1787360275.729689:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360275.729692:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee7216ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4d1 expref: 10 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.729701:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680a00, rc 0) 00000100:00100000:1.0:1787360275.729767:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15593:x1874182575094272:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 482us (708us total) trans 0 rc 301/301 00000100:00100000:1.0:1787360275.729774:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 27 00000100:00100000:2.0:1787360275.735830:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.736109:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094400 00000100:00100000:3.0:1787360275.736118:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094400 00000100:00100000:3.0:1787360275.736175:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787360275.736187:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15593:x1874182575094400:12345-192.168.206.11@tcp:700:lfs.0 00000100:00100000:3.0:1787360275.736302:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15593:x1874182575094400:12345-192.168.206.11@tcp:700:lfs.0 Request processed in 117us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360275.736310:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1787360275.739099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.739184:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094656 00000100:00100000:3.0:1787360275.739193:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094656 00000100:00100000:3.0:1787360275.739277:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:3.0:1787360275.739288:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:15593:x1874182575094656:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:3.0:1787360275.739354:0:17241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360275.739379:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7215db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef43e expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.739398:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:3.0:1787360275.739402:0:17241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360275.739456:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.739470:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.739597:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.739692:0:17241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 5 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.739709:0:17241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 5 pid: 17206 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360275.739724:0:17241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17241:1874182596149504:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360275.739803:0:17241:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a2ecf1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360275.743278:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.743386:0:17241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17241:1874182596149504:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360275.743418:0:17241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360275.743494:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094784 00000100:00100000:0.0:1787360275.743501:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094784 00010000:00010000:0.0:1787360275.743535:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 6 pid: 17206 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360275.743570:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 15 00000100:00100000:0.0:1787360275.743579:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2400:x1874182575094784:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360275.743591:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360275.743597:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 6 pid: 17206 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743608:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 6 pid: 17206 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743631:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee72161a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ae expref: 6 pid: 17206 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743676:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:0.0:1787360275.743682:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743690:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743698:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.743724:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360275.743769:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2400:x1874182575094784:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 190us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360275.743777:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 15 00010000:00010000:3.0:1787360275.743834:0:17241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.743848:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.743871:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.743881:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.743890:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745848:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745867:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745877:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360275.745894:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005bd4a65 reply state 00000000f9e34ec7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745904:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745911:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:3.0:1787360275.745914:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360275.745917:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787360275.745922:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787360275.745935:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745942:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745949:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745955:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360275.745959:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745966:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745976:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4100) 00010000:00010000:3.0:1787360275.745978:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360275.745982:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.745998:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7216c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360275.746015:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005bd4a65 reply state 00000000f9e34ec7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.746023:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360275.746029:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed0000) 00010000:00010000:3.0:1787360275.746031:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360275.746037:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787360275.746119:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+10:15593:x1874182575094656:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 6829us (7025us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787360275.746127:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 28 00000100:00100000:2.0:1787360275.858653:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.858805:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575094912 00000100:00100000:1.0:1787360275.858815:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575094912 00000100:00100000:1.0:1787360275.858886:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:1.0:1787360275.858897:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+10:15601:x1874182575094912:12345-192.168.206.11@tcp:101:lctl.0 00010000:00010000:1.0:1787360275.858919:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360275.858940:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4d8 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859015:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859027:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859050:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360275.859092:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360275.859096:0:17207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360275.859131:0:17207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859155:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4d8 expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859173:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680000/0x359a4e2aee7216de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4d8 expref: 11 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.859181:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:1.0:1787360275.859184:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360275.859187:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680000, rc 0) 00000100:00100000:1.0:1787360275.859297:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+11:15601:x1874182575094912:12345-192.168.206.11@tcp:101:lctl.0 Request processed in 402us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.859305:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 29 00000100:00100000:2.0:1787360275.893498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360275.893606:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575095040 00000100:00100000:0.0:1787360275.893616:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575095040 00000100:00100000:0.0:1787360275.893681:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 30 00000100:00100000:0.0:1787360275.893690:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:15602:x1874182575095040:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360275.893707:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360275.893727:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7216e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4df expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893785:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893799:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893809:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360275.893880:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787360275.893884:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360275.893902:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893925:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7216e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4df expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893944:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688400/0x359a4e2aee7216ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4df expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.893952:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:0.0:1787360275.893954:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360275.893958:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688400, rc 0) 00000100:00100000:0.0:1787360275.894027:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15602:x1874182575095040:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 337us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360275.894035:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 30 00010000:00010000:0.0:1787360275.897456:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360275.902163:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.902265:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575095168 00000100:00100000:1.0:1787360275.902276:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575095168 00000100:00100000:1.0:1787360275.902334:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:1.0:1787360275.902344:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:15602:x1874182575095168:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360275.902363:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360275.902382:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4e6 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902462:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902475:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902486:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902497:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902504:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902510:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902585:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902594:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902601:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360275.902648:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360275.902652:0:17207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360275.902674:0:17207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902694:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902700:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902708:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902714:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360275.902718:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902726:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902738:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:1.0:1787360275.902741:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360275.902745:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902751:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680400/0x359a4e2aee7216fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902764:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902770:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902776:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902788:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680a00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360275.902791:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902797:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902805:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed0000) 00010000:00010000:1.0:1787360275.902808:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360275.902810:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902816:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902839:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee7216f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4e6 expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902851:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4e6 expref: 7 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.902858:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:1.0:1787360275.902860:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360275.902862:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06681e00, rc 0) 00000100:00100000:1.0:1787360275.902920:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:15602:x1874182575095168:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 577us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.902928:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 31 00000100:00100000:2.0:1787360275.905570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.905701:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575095296 00000100:00100000:1.0:1787360275.905722:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575095296 00000100:00100000:1.0:1787360275.905819:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360275.905830:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:15602:x1874182575095296:12345-192.168.206.11@tcp:900:lfs.0 00000100:00100000:1.0:1787360275.905901:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:15602:x1874182575095296:12345-192.168.206.11@tcp:900:lfs.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.905908:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:2.0:1787360275.914614:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360275.914717:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575095552 00000100:00100000:0.0:1787360275.914728:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575095552 00000100:00100000:0.0:1787360275.914780:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:0.0:1787360275.914790:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+7:15602:x1874182575095552:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360275.914808:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360275.914825:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee72170f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4ed expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360275.914918:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787360275.915033:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee72170f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ed expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.915047:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:0.0:1787360275.915050:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360275.915055:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee72170f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4ed expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.915070:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:0.0:1787360275.915129:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+8:15602:x1874182575095552:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 340us (523us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787360275.915137:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 32 00000100:00100000:2.0:1787360275.918160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.918264:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575095808 00000100:00100000:1.0:1787360275.918274:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575095808 00000100:00100000:1.0:1787360275.918329:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:1.0:1787360275.918339:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+8:15602:x1874182575095808:12345-192.168.206.11@tcp:36:lfs.0 00010000:00010000:1.0:1787360275.918388:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360275.918414:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721708 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4e6 expref: 8 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.918432:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:1.0:1787360275.918437:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360275.918457:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.918469:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.918478:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360275.918680:0:17207:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006591f5b9 reply state 000000003e01edc3 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.918693:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.918707:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:1.0:1787360275.918709:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787360275.918712:0:17207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787360275.918719:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787360275.918791:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+9:15602:x1874182575095808:12345-192.168.206.11@tcp:36:lfs.0 Request processed in 452us (638us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787360275.918798:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 33 00000100:00100000:2.0:1787360275.925195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.925726:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096064 00000100:00100000:3.0:1787360275.925736:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096064 00000100:00100000:3.0:1787360275.925800:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:3.0:1787360275.925812:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+9:15602:x1874182575096064:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360275.926201:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+10:15602:x1874182575096064:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 390us (1013us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787360275.926210:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:2.0:1787360275.937600:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360275.939742:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096320 00000100:00100000:0.0:1787360275.939756:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096320 00000100:00100000:0.0:1787360275.939871:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:0.0:1787360275.939882:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+10:15602:x1874182575096320:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360275.939905:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360275.939922:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee721724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4f4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.939981:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940016:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940027:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940054:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940062:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940068:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360275.940161:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787360275.940218:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940244:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940250:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940256:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689000 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360275.940260:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940268:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940281:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:0.0:1787360275.940284:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360275.940287:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940303:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee72172b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940318:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940323:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940329:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940334:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360275.940337:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940343:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940351:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed0000) 00010000:00010000:0.0:1787360275.940353:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360275.940356:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940362:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721732 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940390:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee721724 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4f4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940410:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:0.0:1787360275.940412:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360275.940416:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee721724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4f4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360275.940425:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:0.0:1787360275.940494:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+11:15602:x1874182575096320:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 614us (3033us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787360275.940501:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 34 00000100:00100000:2.0:1787360275.946287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.946452:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096448 00000100:00100000:1.0:1787360275.946462:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096448 00000100:00100000:1.0:1787360275.946521:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:1.0:1787360275.946532:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+11:15602:x1874182575096448:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:1.0:1787360275.946553:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360275.946574:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721740 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef4fb expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946674:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946689:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946700:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360275.946725:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787360275.946729:0:17207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787360275.946747:0:17207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946790:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee721740 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 13 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946808:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360275.946816:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:1.0:1787360275.946819:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360275.946838:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680a00, rc 0) 00000100:00100000:1.0:1787360275.946895:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a037a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+12:15602:x1874182575096448:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 365us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.946903:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 35 00000100:00100000:2.0:1787360275.959044:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360275.959550:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096576 00000100:00100000:1.0:1787360275.959560:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096576 00000100:00100000:1.0:1787360275.959615:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:1.0:1787360275.959626:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+12:15602:x1874182575096576:12345-192.168.206.11@tcp:37:lfs.0 00000100:00100000:1.0:1787360275.966612:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+12:15602:x1874182575096576:12345-192.168.206.11@tcp:37:lfs.0 Request processed in 6976us (7567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360275.966726:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 3 00000100:00100000:2.0:1787360275.979319:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360275.979591:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096832 00000100:00100000:3.0:1787360275.979603:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096832 00000100:00100000:3.0:1787360275.979679:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:3.0:1787360275.979691:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989034a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+12:15602:x1874182575096832:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:3.0:1787360275.979913:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989034a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:924bac3c-3aca-4cde-8ca8-f46336646f6e+13:15602:x1874182575096832:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 225us (604us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787360275.979922:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 4 00000100:00100000:2.0:1787360276.071874:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.072061:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575096960 00000100:00100000:3.0:1787360276.072070:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575096960 00000100:00100000:3.0:1787360276.072134:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:3.0:1787360276.072145:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+11:15608:x1874182575096960:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360276.072163:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360276.072181:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72174e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef502 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072274:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072302:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072313:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072325:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072332:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072338:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072410:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072418:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072424:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360276.072457:0:17241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787360276.072460:0:17241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787360276.072497:0:17241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072510:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072525:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072532:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072538:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360276.072542:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072549:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072561:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:3.0:1787360276.072564:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360276.072568:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072574:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072586:0:17241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072592:0:17241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072598:0:17241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072603:0:17241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360276.072612:0:17241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072619:0:17241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072638:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed0000) 00010000:00010000:3.0:1787360276.072641:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360276.072651:0:17241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072657:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee72175c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.072684:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72174e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef502 expref: 13 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.073063:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041c00/0x359a4e2aee721763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef502 expref: 12 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.073071:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:3.0:1787360276.073073:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787360276.073076:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041c00, rc 0) 00000100:00100000:2.0:1787360276.086013:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+12:15608:x1874182575096960:12345-192.168.206.11@tcp:101:bash.0 Request processed in 13858us (14138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360276.086026:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 36 00000100:00100000:2.0:1787360276.093812:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.093978:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575097088 00000100:00100000:3.0:1787360276.094000:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575097088 00000100:00100000:3.0:1787360276.094064:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360276.094076:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15608:x1874182575097088:12345-192.168.206.11@tcp:900:bash.0 00000100:00100000:3.0:1787360276.094168:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:15608:x1874182575097088:12345-192.168.206.11@tcp:900:bash.0 Request processed in 94us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360276.094192:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360276.101398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.101496:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575097344 00000100:00100000:3.0:1787360276.101507:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575097344 00000100:00100000:3.0:1787360276.101567:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:3.0:1787360276.101579:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+12:15608:x1874182575097344:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:3.0:1787360276.101597:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360276.101618:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72176a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef509 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.101733:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.101749:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.101758:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.101790:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 12 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.101803:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 12 pid: 17207 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360276.101816:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149632:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360276.101895:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a182436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360276.114160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.114285:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575097472 00000100:00100000:1.0:1787360276.114295:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575097472 00010000:00010000:1.0:1787360276.114337:0:17192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 13 pid: 17207 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360276.114374:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 16 00000100:00100000:1.0:1787360276.114397:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+13:2400:x1874182575097472:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360276.114411:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360276.114418:0:17192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 13 pid: 17207 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.114431:0:17192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 13 pid: 17207 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.114454:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:1.0:1787360276.114459:0:17192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.114468:0:17192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.114485:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.114504:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360276.114556:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+13:2400:x1874182575097472:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 159us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360276.114564:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 16 00010000:00010000:3.0:1787360276.115966:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680a00/0x359a4e2aee721747 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef4fb expref: 12 pid: 17207 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360276.116008:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149632:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360276.116037:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116046:0:17207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116051:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116073:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116084:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116092:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116922:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116934:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.116942:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360276.116953:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787360276.116977:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117003:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117010:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117016:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360276.117181:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117190:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117203:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:3.0:1787360276.117205:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360276.117209:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117216:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721771 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360276.117386:0:17207:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000013218ca reply state 0000000042bde40f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117399:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.117406:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998a28ed0600) 00010000:00010000:3.0:1787360276.117409:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360276.117412:0:17207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787360276.117446:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72176a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 15 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.122178:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 14 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.122195:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:3.0:1787360276.122198:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787360276.122202:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35041e00, rc 0) 00000100:00100000:3.0:1787360276.122312:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890415b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+15:15608:x1874182575097344:12345-192.168.206.11@tcp:101:bash.0 Request processed in 20734us (20920us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787360276.122321:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 37 00000100:00100000:2.0:1787360276.140926:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.141026:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575097600 00000100:00100000:0.0:1787360276.141036:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575097600 00000100:00100000:0.0:1787360276.141094:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:0.0:1787360276.141105:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+15:15608:x1874182575097600:12345-192.168.206.11@tcp:101:bash.0 00010000:00010000:0.0:1787360276.141128:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360276.141148:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee72178d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef510 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141208:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141221:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141279:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360276.141322:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787360276.141339:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360276.141360:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141371:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141392:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee72178d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141408:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.141415:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.141418:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360276.141420:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01688c00, rc 0) 00000100:00100000:0.0:1787360276.141469:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:15608:x1874182575097600:12345-192.168.206.11@tcp:101:bash.0 Request processed in 365us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.141476:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 38 00000100:00100000:2.0:1787360276.150957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.151030:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575097856 00000100:00100000:3.0:1787360276.151040:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575097856 00000100:00100000:3.0:1787360276.151102:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:3.0:1787360276.151120:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:15608:x1874182575097856:12345-192.168.206.11@tcp:35:bash.0 00000100:00100000:2.0:1787360276.153135:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:15608:x1874182575097856:12345-192.168.206.11@tcp:35:bash.0 Request processed in 2011us (2180us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787360276.153150:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 5 00000100:00100000:1.0:1787360276.283160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.283262:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575098112 00000100:00100000:3.0:1787360276.283281:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575098112 00000100:00100000:3.0:1787360276.283346:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:3.0:1787360276.283358:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:15618:x1874182575098112:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:3.0:1787360276.283380:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360276.283399:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72179b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef517 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360276.283499:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787360276.283605:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72179b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef517 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.283651:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff998a28ed4a00) 00010000:00010000:3.0:1787360276.283654:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360276.283660:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee72179b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef517 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.283674:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040e00, rc 0) 00000100:00100000:3.0:1787360276.283913:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+18:15618:x1874182575098112:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 557us (760us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787360276.283921:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 39 00000100:00100000:3.0:1787360276.288778:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.288962:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575098368 00000100:00100000:1.0:1787360276.288972:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575098368 00000100:00100000:1.0:1787360276.289041:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 6 00000100:00100000:1.0:1787360276.289053:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+18:15618:x1874182575098368:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360276.289314:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15618:x1874182575098368:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 263us (547us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787360276.289335:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 6 00000040:00080000:0.0:1787360276.346151:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787360276.346266:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360276.369464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.369539:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575098624 00000100:00100000:0.0:1787360276.369549:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575098624 00000100:00100000:0.0:1787360276.369606:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:0.0:1787360276.369616:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15621:x1874182575098624:12345-192.168.206.11@tcp:101:lfs.0 00010000:00010000:0.0:1787360276.369637:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360276.369656:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef51e expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.369755:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.369780:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.369791:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360276.369804:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360276.369918:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef51e expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.369935:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef51e expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.369944:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.369946:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360276.369949:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689000, rc 0) 00000100:00100000:0.0:1787360276.370013:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15621:x1874182575098624:12345-192.168.206.11@tcp:101:lfs.0 Request processed in 398us (557us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787360276.370020:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 40 00000100:00100000:3.0:1787360276.372539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.372647:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575098752 00000100:00100000:1.0:1787360276.372656:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575098752 00000100:00100000:1.0:1787360276.372718:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:1.0:1787360276.372729:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15621:x1874182575098752:12345-192.168.206.11@tcp:54:lfs.0 00010000:00010000:1.0:1787360276.372788:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372804:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372815:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372847:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372854:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372861:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372867:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06680600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:1.0:1787360276.372871:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372879:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372890:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:1.0:1787360276.372906:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360276.372910:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.372917:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360276.372994:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15621:x1874182575098752:12345-192.168.206.11@tcp:54:lfs.0 Request processed in 267us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360276.373002:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 41 00000100:00100000:3.0:1787360276.373884:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.374000:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575098880 00000100:00100000:0.0:1787360276.374005:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575098880 00000100:00100000:0.0:1787360276.374056:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1787360276.374064:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:2401:x1874182575098880:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360276.374076:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360276.374095:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef51e expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.374123:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.374127:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360276.374173:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+20:2401:x1874182575098880:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.374180:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:2.0:1787360276.380670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.380892:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575099136 00000100:00100000:1.0:1787360276.380901:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575099136 00000100:00100000:1.0:1787360276.380956:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:1.0:1787360276.380965:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+20:15621:x1874182575099136:12345-192.168.206.11@tcp:35:lfs.0 00000100:00100000:1.0:1787360276.381166:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15621:x1874182575099136:12345-192.168.206.11@tcp:35:lfs.0 Request processed in 200us (502us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787360276.381183:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 7 00000100:00100000:3.0:1787360276.838724:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.839218:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575099392 00000100:00100000:0.0:1787360276.839266:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575099392 00000100:00100000:0.0:1787360276.839327:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1787360276.839349:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15652:x1874182575099392:12345-192.168.206.11@tcp:101:cat.0 00010000:00010000:0.0:1787360276.839371:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360276.839390:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef525 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.839798:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.839813:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.839826:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360276.839839:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360276.839963:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee7217c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef525 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.839990:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef525 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.840010:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.840013:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360276.840016:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689200, rc 0) 00000100:00100000:0.0:1787360276.840111:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:15652:x1874182575099392:12345-192.168.206.11@tcp:101:cat.0 Request processed in 765us (1396us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787360276.840120:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 42 00000100:00100000:0.0:1787360276.853567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.853753:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575099520 00000100:00100000:1.0:1787360276.853762:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575099520 00000100:00100000:1.0:1787360276.853832:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:1.0:1787360276.853842:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:2401:x1874182575099520:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360276.853858:0:17192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360276.853881:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689200/0x359a4e2aee7217cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef525 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.853900:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:1.0:1787360276.853905:0:17192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360276.853967:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+22:2401:x1874182575099520:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 126us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360276.853998:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:2.0:1787360276.854968:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.855806:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575099776 00000100:00100000:1.0:1787360276.855815:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575099776 00000100:00100000:1.0:1787360276.855866:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 8 00000100:00100000:1.0:1787360276.855877:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+22:15652:x1874182575099776:12345-192.168.206.11@tcp:35:cat.0 00000100:00100000:1.0:1787360276.856528:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:15652:x1874182575099776:12345-192.168.206.11@tcp:35:cat.0 Request processed in 651us (1561us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787360276.857153:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 8 00010000:00010000:1.0:1787360276.924466:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360276.930710:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360276.931412:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100032 00000100:00100000:1.0:1787360276.931425:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100032 00000100:00100000:1.0:1787360276.931489:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:1.0:1787360276.931500:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:15658:x1874182575100032:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:1.0:1787360276.931527:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360276.931549:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef52c expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931652:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931668:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 24 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931677:0:17207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931685:0:17207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931737:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931752:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 24 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360276.931767:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149760:192.168.206.11@tcp:104: 00010000:00010000:1.0:1787360276.931870:0:17207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 24 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360276.931880:0:17207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 24 pid: 17207 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360276.931889:0:17207:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149888:192.168.206.11@tcp:104: 00000100:00100000:1.0:1787360276.931913:0:17207:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a106af480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360276.935599:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.935642:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.935803:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100160 00000100:00100000:0.0:1787360276.935811:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100160 00010000:00010000:0.0:1787360276.935864:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 25 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360276.935902:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100288 00000100:00100000:0.0:1787360276.935904:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100288 00010000:00010000:0.0:1787360276.935915:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 26 pid: 17207 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360276.935935:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1787360276.935943:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+26:2401:x1874182575100160:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360276.935954:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360276.935961:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 26 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.935974:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 26 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936022:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.936026:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936035:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936042:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360276.936090:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+26:2401:x1874182575100160:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 147us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.936097:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 17 00000100:00100000:0.0:1787360276.936113:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 18 00000100:00100000:0.0:1787360276.936119:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a227f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+25:2401:x1874182575100288:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360276.936126:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360276.936131:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 25 pid: 17207 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936142:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 25 pid: 17207 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936151:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.936155:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936167:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936183:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.936199:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360276.936217:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a227f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+25:2401:x1874182575100288:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 97us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.936251:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 18 00010000:00010000:1.0:1787360276.938005:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef510 expref: 24 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360276.938031:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149760:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360276.938132:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041e00/0x359a4e2aee72177f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef509 expref: 23 pid: 17207 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360276.938144:0:17207:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9989040a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17207:1874182596149888:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360276.938167:0:17207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.938177:0:17207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.938182:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360276.938199:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360276.938458:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680600/0x359a4e2aee7217da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef52c expref: 24 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.938540:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680e00/0x359a4e2aee7217e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef52c expref: 23 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.938550:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.938563:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360276.938567:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680e00, rc 0) 00000100:00100000:0.0:1787360276.938726:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:15658:x1874182575100032:12345-192.168.206.11@tcp:101:dd.0 Request processed in 7227us (8025us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787360276.938735:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 43 00000100:00100000:0.0:1787360276.942395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360276.942464:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100416 00000100:00100000:2.0:1787360276.942526:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100416 00000100:00100000:2.0:1787360276.942588:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1787360276.942597:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+23:15658:x1874182575100416:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1787360276.942618:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360276.942716:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7217ef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef533 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.942747:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.942759:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.942769:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.942975:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee7217ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 25 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.943004:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 24 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.943023:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360276.943026:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360276.943029:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70c00, rc 0) 00000100:00100000:2.0:1787360276.943115:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+24:15658:x1874182575100416:12345-192.168.206.11@tcp:101:dd.0 Request processed in 517us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360276.943122:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 44 00000100:00100000:2.0:1787360276.946799:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.946928:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100672 00000100:00100000:3.0:1787360276.946937:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100672 00000100:00100000:3.0:1787360276.947145:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 45 00000100:00100000:3.0:1787360276.947155:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+24:15658:x1874182575100672:12345-192.168.206.11@tcp:36:dd.0 00010000:00010000:3.0:1787360276.947384:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.947400:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.947426:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360276.947478:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787360276.947499:0:17205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f8b28c8 reply state 00000000851a33d4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.947512:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.947518:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:3.0:1787360276.947521:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360276.947524:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360276.947715:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575100672:12345-192.168.206.11@tcp:36:dd.0 Request processed in 561us (922us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787360276.947723:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 45 00000020:00080000:3.0:1787360276.947727:0:17205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787360276.949538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360276.949997:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575100800 00000100:00100000:3.0:1787360276.950005:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575100800 00000100:00100000:3.0:1787360276.950055:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:3.0:1787360276.950064:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575100800:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:3.0:1787360276.950084:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360276.950102:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721804 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef53a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.950149:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721804 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef53a expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.950161:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721804 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef53a expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360276.950190:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:3.0:1787360276.950193:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787360276.950196:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040c00, rc 0) 00000100:00100000:3.0:1787360276.950364:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15658:x1874182575100800:12345-192.168.206.11@tcp:101:dd.0 Request processed in 300us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360276.950371:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 46 00000100:00100000:1.0:1787360276.960821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.961155:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101056 00000100:00100000:0.0:1787360276.961166:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101056 00000100:00100000:0.0:1787360276.961305:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:0.0:1787360276.961316:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15658:x1874182575101056:12345-192.168.206.11@tcp:103:dd.0 00010000:00010000:0.0:1787360276.961330:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360276.961353:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040c00/0x359a4e2aee721804 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef53a expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.961371:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360276.961376:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360276.961429:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575101056:12345-192.168.206.11@tcp:103:dd.0 Request processed in 115us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.961437:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 2 00000100:00100000:1.0:1787360276.967151:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360276.967960:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101184 00000100:00100000:0.0:1787360276.967970:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101184 00000100:00100000:0.0:1787360276.968043:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:0.0:1787360276.968054:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575101184:12345-192.168.206.11@tcp:58:dd.0 00010000:00010000:0.0:1787360276.968155:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.968173:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360276.968196:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360276.969222:0:17207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360276.969782:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787360276.969892:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787360276.970034:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575101184:12345-192.168.206.11@tcp:58:dd.0 Request processed in 1976us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360276.970045:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 47 00000100:00100000:3.0:1787360276.977133:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360276.977585:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101312 00000100:00100000:2.0:1787360276.977595:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101312 00000100:00100000:2.0:1787360276.977686:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 48 00000100:00100000:2.0:1787360276.977697:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+27:15658:x1874182575101312:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1787360276.977716:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360276.977737:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef541 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977790:0:17241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977801:0:17241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977819:0:17241:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977832:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977869:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360276.977872:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360276.977876:0:17241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 28 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360276.977884:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70800, rc 0) 00000100:00100000:2.0:1787360276.977946:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15658:x1874182575101312:12345-192.168.206.11@tcp:101:dd.0 Request processed in 251us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360276.977961:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 48 00000040:00080000:3.0:1787360277.369423:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787360277.369433:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360277.369459:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787360277.369468:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787360277.369607:0:17242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17242:1874182596150016:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787360277.369708:0:17242:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a6bce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360277.377018:0:17242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b86300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17242:1874182596150016:192.168.206.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787360277.383303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.383439:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101440 00000100:00100000:3.0:1787360277.383449:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101440 00000100:00100000:3.0:1787360277.383571:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00100000:3.0:1787360277.383585:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15660:x1874182575101440:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787360277.383615:0:17205:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787360277.383749:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15660:x1874182575101440:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 169us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360277.383757:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 49 00000100:00080000:1.0:1787360277.383817:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360277.394768:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360277.395081:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101568 00000100:00100000:0.0:1787360277.395091:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101568 00000100:00100000:0.0:1787360277.395160:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360277.395172:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15660:x1874182575101568:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787360277.395284:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395300:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395310:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395366:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395374:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395380:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395416:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395426:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395432:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360277.395474:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787360277.395478:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360277.395490:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395500:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395507:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395513:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395519:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360277.395523:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395530:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395541:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a28ed0400) 00010000:00010000:0.0:1787360277.395548:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360277.395553:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395559:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee721819 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395572:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395578:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395584:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395588:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360277.395591:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395597:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395604:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff998a07c29100) 00010000:00010000:0.0:1787360277.395607:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360277.395609:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395615:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689800/0x359a4e2aee721820 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395691:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395704:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395710:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395715:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01688800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360277.395718:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395724:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395732:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:0.0:1787360277.395735:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360277.395737:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.395743:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688800/0x359a4e2aee721827 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360277.395828:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15660:x1874182575101568:12345-192.168.206.11@tcp:34:lhsmtool_posix.0 Request processed in 657us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360277.395836:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 50 00000100:00100000:0.0:1787360277.423409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.423518:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101824 00000100:00100000:3.0:1787360277.423528:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101824 00000100:00100000:3.0:1787360277.423591:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:3.0:1787360277.423615:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+28:15660:x1874182575101824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360277.423633:0:17207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360277.423651:0:17207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee72182e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef548 expref: -99 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423776:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423792:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423802:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360277.423812:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787360277.423881:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423888:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423894:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423899:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.423904:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423910:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423921:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:3.0:1787360277.423929:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360277.423933:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423939:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee721835 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423988:0:17207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee72182e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef548 expref: 30 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.423999:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff998a28ed0400) 00010000:00010000:3.0:1787360277.424001:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360277.424005:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee72182e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef548 expref: 30 pid: 17207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.424014:0:17207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a35040200, rc 0) 00000100:00100000:3.0:1787360277.424218:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+29:15660:x1874182575101824:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 605us (816us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787360277.424417:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 51 00000100:00100000:1.0:1787360277.445429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360277.448108:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575101952 00000100:00100000:0.0:1787360277.448121:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575101952 00000100:00100000:0.0:1787360277.449486:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:0.0:1787360277.449504:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+29:15660:x1874182575101952:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787360277.449554:0:17206:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787360277.449679:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9989040a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+29:15660:x1874182575101952:12345-192.168.206.11@tcp:53:lhsmtool_posix.0 Request processed in 181us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360277.449686:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 52 00000100:00100000:3.0:1787360277.452009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360277.452411:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575102208 00000100:00100000:1.0:1787360277.452420:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575102208 00000100:00100000:1.0:1787360277.452487:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1787360277.452497:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+29:15660:x1874182575102208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360277.452516:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360277.452535:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681200/0x359a4e2aee721843 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef54f expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360277.452962:0:17205:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:1.0:1787360277.453182:0:17205:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1787360277.453200:0:17205:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787360277.453442:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680200/0x359a4e2aee72184a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.453456:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680200/0x359a4e2aee72184a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.453555:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680200/0x359a4e2aee72184a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.453609:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681200/0x359a4e2aee721843 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef54f expref: 32 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.453732:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680200/0x359a4e2aee72184a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef54f expref: 31 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.453741:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4800) 00010000:00010000:1.0:1787360277.453744:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360277.453757:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680200, rc 0) 00000100:00100000:1.0:1787360277.453860:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+31:15660:x1874182575102208:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 1363us (1856us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787360277.453868:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 53 00000100:00100000:1.0:1787360277.462917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.463013:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575102464 00000100:00100000:2.0:1787360277.463023:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575102464 00000100:00100000:3.0:1787360277.463678:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:3.0:1787360277.463696:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+31:15660:x1874182575102464:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360277.463747:0:17207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360277.463773:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680200/0x359a4e2aee72184a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef54f expref: 31 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463792:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4800) 00010000:00010000:3.0:1787360277.463802:0:17207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360277.463850:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463864:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463875:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463889:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463895:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463902:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463943:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463950:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463956:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463962:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.463966:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.463984:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.464003:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:3.0:1787360277.464006:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.464010:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.464016:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040200/0x359a4e2aee721858 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.464026:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.466695:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.466706:0:17207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.466713:0:17207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.466718:0:17207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.466726:0:17207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.466742:0:17207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5ed36aa8 (ffff998a28ed0700) 00010000:00010000:3.0:1787360277.466745:0:17207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.467076:0:17207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.467086:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040600/0x359a4e2aee72185f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5ed36aa8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360277.467496:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+30:15660:x1874182575102464:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 3538us (4321us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787360277.467506:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 54 00000100:00100000:2.0:1787360277.473807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360277.475830:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575102592 00000100:00100000:1.0:1787360277.475843:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575102592 00000100:00100000:1.0:1787360277.476022:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:1.0:1787360277.476034:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+30:15660:x1874182575102592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360277.476054:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360277.476076:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681200/0x359a4e2aee721866 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef556 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476109:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680800/0x359a4e2aee72186d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476121:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680800/0x359a4e2aee72186d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476131:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680800/0x359a4e2aee72186d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476260:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681200/0x359a4e2aee721866 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef556 expref: 32 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476279:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06680800/0x359a4e2aee72186d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef556 expref: 31 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.476287:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:1.0:1787360277.476296:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360277.476300:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a06680800, rc 0) 00000100:00100000:1.0:1787360277.476383:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+31:15660:x1874182575102592:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 351us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360277.476391:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 55 00000100:00100000:0.0:1787360277.480505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.480599:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575102848 00000100:00100000:2.0:1787360277.480608:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575102848 00000100:00100000:2.0:1787360277.480705:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1787360277.480725:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+31:15660:x1874182575102848:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360277.480809:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.480827:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.480839:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360277.481010:0:17241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787360277.481019:0:17241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 555727792744ns, next at 556727790649ns, rc = 0 00000004:00010000:2.0:1787360277.481077:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a157aba3 reply state 00000000681b5a2b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.481089:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.481097:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:2.0:1787360277.481099:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787360277.481103:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360277.481193:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+33:15660:x1874182575102848:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 479us (697us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787360277.481200:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 56 00000100:00100000:2.0:1787360277.484389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360277.485699:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575102976 00000100:00100000:0.0:1787360277.485711:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575102976 00000100:00100000:0.0:1787360277.485778:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:0.0:1787360277.485789:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+33:15660:x1874182575102976:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360277.485823:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360277.485841:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef55d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.485893:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 34 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.485906:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 34 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.485923:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:0.0:1787360277.485926:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360277.485930:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689400, rc 0) 00000100:00100000:0.0:1787360277.486005:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+34:15660:x1874182575102976:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 217us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360277.486012:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 57 00000100:00100000:1.0:1787360277.492029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.492270:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575103104 00000100:00100000:3.0:1787360277.492280:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575103104 00000100:00100000:3.0:1787360277.492354:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:3.0:1787360277.492369:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2400:x1874182575103104:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787360277.492604:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2400:x1874182575103104:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 240us (585us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787360277.492613:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00080000:1.0:1787360277.493186:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360277.499481:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.500998:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575103360 00000100:00100000:3.0:1787360277.501011:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575103360 00000100:00100000:3.0:1787360277.501087:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:3.0:1787360277.501099:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+34:15660:x1874182575103360:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360277.501383:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+35:15660:x1874182575103360:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 285us (1910us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787360277.501391:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 9 00000100:00100000:0.0:1787360277.509591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.510630:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575103616 00000100:00100000:3.0:1787360277.510642:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575103616 00000100:00100000:3.0:1787360277.510712:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:3.0:1787360277.510722:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+35:15660:x1874182575103616:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360277.510831:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+35:15660:x1874182575103616:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 110us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360277.510838:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 58 00000100:00100000:2.0:1787360277.518117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360277.518269:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575103744 00000100:00100000:0.0:1787360277.518279:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575103744 00000100:00100000:0.0:1787360277.518346:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:0.0:1787360277.518357:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+35:15660:x1874182575103744:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360277.518376:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360277.518397:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721882 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef564 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518465:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518480:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518491:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360277.518537:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787360277.518554:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518579:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01688c00/0x359a4e2aee721882 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef564 expref: 37 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518598:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef564 expref: 36 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.518606:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:0.0:1787360277.518609:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360277.518613:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998a01689000, rc 0) 00000100:00100000:0.0:1787360277.518693:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+36:15660:x1874182575103744:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 338us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360277.518701:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 59 00000100:00100000:1.0:1787360277.528165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.529864:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575103872 00000100:00100000:2.0:1787360277.529876:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575103872 00000100:00100000:2.0:1787360277.529947:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360277.529957:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+6:2399:x1874182575103872:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360277.529973:0:18711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360277.530004:0:18711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef56b expref: -99 pid: 18711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360277.530030:0:18711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f415, blocks: 0x0 00010000:00010000:2.0:1787360277.530049:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1787360277.530053:0:18711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360277.530063:0:18711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 7 pid: 18711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.530101:0:18711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 7 pid: 18711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.530116:0:18711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70e00, rc 0) 00000100:00100000:2.0:1787360277.530184:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:2399:x1874182575103872:12345-192.168.206.11@tcp:101:lhsmtool_posix.0 Request processed in 228us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360277.530192:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:2.0:1787360277.547166:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.547317:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104128 00000100:00100000:3.0:1787360277.547337:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104128 00000100:00100000:3.0:1787360277.547402:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:3.0:1787360277.547413:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+36:15660:x1874182575104128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360277.547521:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+36:15660:x1874182575104128:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360277.547528:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 60 00000100:00100000:1.0:1787360277.552265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.552600:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104256 00000100:00100000:3.0:1787360277.552610:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104256 00000100:00100000:3.0:1787360277.552683:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:3.0:1787360277.552694:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+36:15660:x1874182575104256:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787360277.557111:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787360277.557126:0:17185:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787360277.557181:0:17185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1787360277.558409:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558422:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558430:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558436:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:0.0:1787360277.558441:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558448:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558476:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:0.0:1787360277.558480:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787360277.558485:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.558490:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681800/0x359a4e2aee72171d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360277.558654:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15660:x1874182575104256:12345-192.168.206.11@tcp:44:lhsmtool_posix.0 Request processed in 5957us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360277.558663:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 61 00000100:00100000:2.0:1787360277.560499:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787360277.560518:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596150144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787360277.560584:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360277.561903:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596150144 00000100:00100000:1.0:1787360277.561913:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596150144 00000100:00100000:1.0:1787360277.561996:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787360277.562006:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a05b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596150144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787360277.562136:0:18713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787360277.562140:0:18713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787360277.562143:0:18713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787360277.562145:0:18713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787360277 -> 1787360277 00002000:00010000:1.0:1787360277.562148:0:18713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787360277.562206:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a05b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1874182596150144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (1621us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787360277.562214:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:1.0:1787360277.562411:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff998904329880/2, rc 0, transno 8589934596 00000100:00100000:1.0:1787360277.562418:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596150144:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787360277.563763:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787360277.565359:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565374:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565382:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565388:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040800 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.565393:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565401:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565416:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff998a28ed0000) 00010000:00010000:3.0:1787360277.565419:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.565430:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565436:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040800/0x359a4e2aee7216c9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565458:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565708:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565715:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565721:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.565724:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565730:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565740:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff998a28ed0800) 00010000:00010000:3.0:1787360277.565742:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.565744:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565750:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7216d0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565765:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565783:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565789:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565794:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.565797:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565804:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565813:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff998a28ed0600) 00010000:00010000:3.0:1787360277.565816:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.565818:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565824:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee721778 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565839:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565845:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565851:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565855:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.565871:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565877:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565886:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:3.0:1787360277.565889:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360277.565891:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565897:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee7217fd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565908:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565914:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565920:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565925:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71600 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:3.0:1787360277.565928:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565933:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565941:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:3.0:1787360277.565944:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360277.565953:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.565959:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71600/0x359a4e2aee721874 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360277.579036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.579129:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104384 00000100:00100000:2.0:1787360277.579139:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104384 00000100:00100000:2.0:1787360277.579199:0:19590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360277.579209:0:19590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:2400:x1874182575104384:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787360277.579356:0:19590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:2400:x1874182575104384:12345-192.168.206.11@tcp:16:lhsmtool_posix.0 Request processed in 147us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360277.579363:0:19590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:2.0:1787360277.602325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.602423:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104640 00000100:00100000:3.0:1787360277.602432:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104640 00000100:00100000:3.0:1787360277.602496:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:3.0:1787360277.602507:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+15:15660:x1874182575104640:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360277.602559:0:17241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360277.602586:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689000/0x359a4e2aee721889 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef564 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.602605:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:3.0:1787360277.602609:0:17241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360277.602648:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.602661:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.602670:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360277.602785:0:17241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a918364 reply state 00000000d528399c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.602798:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35040e00/0x359a4e2aee721897 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.602820:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:3.0:1787360277.602833:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787360277.602837:0:17241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360277.602937:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:15660:x1874182575104640:12345-192.168.206.11@tcp:36:lhsmtool_posix.0 Request processed in 431us (620us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787360277.602943:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 62 00000100:00100000:1.0:1787360277.611535:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360277.611788:0:19239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104768 00000100:00100000:0.0:1787360277.611798:0:19239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104768 00000100:00100000:0.0:1787360277.611866:0:19239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1787360277.611876:0:19239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:2399:x1874182575104768:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787360277.612030:0:19239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787360277.612034:0:19239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787360276 00002000:00010000:0.0:1787360277.612037:0:19239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787360276 00002000:00010000:0.0:1787360277.612039:0:19239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787360277 -> 1787360276 00002000:00010000:0.0:1787360277.612041:0:19239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787360277.612104:0:19239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+8:2399:x1874182575104768:12345-192.168.206.11@tcp:2:lhsmtool_posix.0 Request processed in 229us (577us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787360277.612112:0:19239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 25 00000100:00100000:0.0:1787360277.617172:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360277.617635:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575104896 00000100:00100000:1.0:1787360277.617659:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575104896 00000100:00100000:1.0:1787360277.617718:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:1.0:1787360277.617730:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+8:2402:x1874182575104896:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787360277.617773:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617790:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360277.617794:0:18713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360277.617799:0:18713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617812:0:18713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617839:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617847:0:18713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617866:0:18713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617874:0:18713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:1.0:1787360277.617879:0:18713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617900:0:18713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617915:0:18713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.617923:0:18713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071af64f6/0x359a4e2aee72189e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360277.618010:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+8:2402:x1874182575104896:12345-192.168.206.11@tcp:1:lhsmtool_posix.0 Request processed in 282us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360277.618018:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 26 00000100:00100000:3.0:1787360277.638874:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360277.639041:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105152 00000100:00100000:1.0:1787360277.639052:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105152 00000100:00100000:1.0:1787360277.639129:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 63 00000100:00100000:1.0:1787360277.639140:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+16:15660:x1874182575105152:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787360277.639217:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.639280:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.639289:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.643926:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 16 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.643971:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 16 pid: 17241 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360277.643998:0:17205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890432b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150272:192.168.206.11@tcp:104: 00000100:00100000:2.0:1787360277.644150:0:17205:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a0aaa8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360277.671149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360277.671278:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105280 00000100:00100000:1.0:1787360277.671302:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105280 00010000:00010000:1.0:1787360277.671358:0:20233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 17 pid: 17241 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360277.671393:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 19 00000100:00100000:1.0:1787360277.671402:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:2400:x1874182575105280:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360277.671416:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360277.671423:0:20233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 17 pid: 17241 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671437:0:20233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 17 pid: 17241 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671461:0:20233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:1.0:1787360277.671467:0:20233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 17 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671477:0:20233:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671485:0:20233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671491:0:20233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360277.671511:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360277.671562:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904058000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:2400:x1874182575105280:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 160us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360277.671577:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 19 00010000:00010000:3.0:1787360277.672138:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70c00/0x359a4e2aee7217f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef533 expref: 16 pid: 17241 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360277.672154:0:17205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890432b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150272:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360277.672173:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672181:0:17205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672187:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672895:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672912:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672920:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672970:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.672993:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 16 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360277.673005:0:17205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150400:192.168.206.11@tcp:104: 00000100:00100000:3.0:1787360277.673077:0:17205:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a1a6bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1787360277.690148:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.693073:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105408 00000100:00100000:2.0:1787360277.693089:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105408 00010000:00010000:2.0:1787360277.693135:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 17 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360277.693182:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 20 00000100:00100000:2.0:1787360277.693192:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:2399:x1874182575105408:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360277.693207:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360277.693214:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 17 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.693265:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 17 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.693287:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:2.0:1787360277.693293:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.693302:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.693343:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.693362:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360277.693422:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904059c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+17:2399:x1874182575105408:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 231us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360277.693429:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 20 00010000:00010000:3.0:1787360277.699836:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689400/0x359a4e2aee72187b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef55d expref: 16 pid: 17206 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360277.699863:0:17205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b85880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150400:192.168.206.11@tcp:104: 00010000:00010000:3.0:1787360277.699893:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.704589:0:17205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.704605:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360277.704885:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787360277.705012:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787360277.705048:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787360277.705879:0:17205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17205:1874182596150528:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787360277.705948:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360277.706038:0:17205:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478180 going to sleep for 11 seconds 00000100:00100000:3.0:1787360277.709037:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596150528 00000100:00100000:3.0:1787360277.709051:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596150528 00000100:00100000:2.0:1787360277.715103:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787360277.715125:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17205:x1874182596150528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787360277.716032:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17205:x1874182596150528:12345-0@lo:1000:mdt00_000.0 Request processed in 915us (10082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360277.716042:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787360277.716096:0:17205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17205:1874182596150528:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787360277.717994:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787360277.718075:0:17205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17205:1874182596150656:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787360277.718156:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360277.718192:0:17205:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360277.718604:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596150656 00000100:00100000:1.0:1787360277.718612:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596150656 00000100:00100000:1.0:1787360277.718676:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360277.718686:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a3cb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17205:x1874182596150656:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787360277.719091:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a3cb0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17205:x1874182596150656:12345-0@lo:1000:mdt00_000.0 Request processed in 406us (934us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787360277.719099:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787360277.719499:0:17205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17205:1874182596150656:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787360277.719540:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719551:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719558:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719563:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041400 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360277.719567:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719573:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719588:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:2.0:1787360277.719591:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360277.719595:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719600:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041400/0x359a4e2aee7218ac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719644:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719651:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719677:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719682:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360277.719686:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719691:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719700:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360277.719702:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360277.719708:0:17205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719719:0:17205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719908:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.719964:0:17205:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70800/0x359a4e2aee721812 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef541 expref: 19 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360277.719987:0:17205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150784:192.168.206.11@tcp:105: 00000100:00100000:2.0:1787360277.720057:0:17205:0:(client.c:2715:ptlrpc_set_wait()) set ffff998903478600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360277.728035:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.728145:0:17205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17205:1874182596150784:192.168.206.11@tcp:105: 00010000:00010000:2.0:1787360277.728183:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728194:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a01689c00/0x359a4e2aee72180b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728276:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728290:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728300:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728318:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728944:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728952:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728957:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998903b71e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360277.728962:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728969:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.728992:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360277.729003:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360277.729007:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729014:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729028:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729034:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729040:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729045:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a06681e00 already unused, calling callback (ffffffffc1acf4f0) 00010000:00010000:2.0:1787360277.729048:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729054:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729062:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360277.729064:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360277.729067:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.729073:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a06681e00/0x359a4e2aee7218a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360277.729654:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15660:x1874182575105152:12345-192.168.206.11@tcp:57:lhsmtool_posix.0 Request processed in 90513us (90785us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787360277.729676:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 63 00000020:00080000:2.0:1787360277.729682:0:17205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787360277.730136:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105536 00000100:00100000:3.0:1787360277.730145:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105536 00000100:00100000:3.0:1787360277.730201:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 10 00000100:00100000:3.0:1787360277.730212:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2dfe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15658:x1874182575105536:12345-192.168.206.11@tcp:49:dd.0 00000100:00100000:3.0:1787360277.730674:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2dfe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15658:x1874182575105536:12345-192.168.206.11@tcp:49:dd.0 Request processed in 464us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360277.730681:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 10 00000040:00080000:1.0:1787360277.730941:0:17242:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787360277.730946:0:17242:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360277.730964:0:17242:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787360277.730969:0:17242:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787360277.736639:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360277.736800:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105792 00000100:00100000:3.0:1787360277.736810:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105792 00000100:00100000:3.0:1787360277.736881:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 11 00000100:00100000:3.0:1787360277.736891:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+19:15660:x1874182575105792:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787360277.737203:0:17208:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787360277.737441:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787360277.737714:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737731:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737741:0:17208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737749:0:17208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737755:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737761:0:17208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360277.737773:0:17208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787360277.737916:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15660:x1874182575105792:12345-192.168.206.11@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1292us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787360277.737926:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 11 00000020:00080000:3.0:1787360277.737930:0:17208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787360277.738068:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360277.738075:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.738083:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35041200 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:0.0:1787360277.738086:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.738093:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.738105:0:17193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff998a28ed4000) 00010000:00010000:0.0:1787360277.738108:0:17193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787360277.738134:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.738139:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998a35041200/0x359a4e2aee7218ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360277.738152:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360277.738154:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360277.738156:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360277.743295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360277.743806:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575105920 00000100:00100000:2.0:1787360277.743817:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575105920 00000100:00100000:2.0:1787360277.743873:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 64 00000100:00100000:2.0:1787360277.743883:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+21:15658:x1874182575105920:12345-192.168.206.11@tcp:101:dd.0 00010000:00010000:2.0:1787360277.743901:0:17241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360277.743921:0:17241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7807fb8fcb4ef572 expref: -99 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.743955:0:17241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee7218c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.743969:0:17241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee7218c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.743992:0:17241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee7218c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.744101:0:17241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff998903b71e00/0x359a4e2aee7218c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef572 expref: 23 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.744131:0:17241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff998903b70000/0x359a4e2aee7218c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef572 expref: 22 pid: 17241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360277.744141:0:17241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff998a28ed0900) 00010000:00010000:2.0:1787360277.744143:0:17241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360277.744146:0:17241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff998903b70000, rc 0) 00000100:00100000:2.0:1787360277.744211:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+22:15658:x1874182575105920:12345-192.168.206.11@tcp:101:dd.0 Request processed in 329us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360277.744219:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 64 00010000:00010000:1.0:1787360277.945642:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360278.004928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:0.0:1787360278.005167:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106048 00000100:00100000:0.0:1787360278.005177:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106048 00000100:00100000:0.0:1787360278.005281:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:0.0:1787360278.005293:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+8:2400:x1874182575106048:12345-192.168.206.11@tcp:4:dd.0 00010000:00010000:0.0:1787360278.005326:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.005345:0:18717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 8 pid: 18711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.005354:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787360278.005358:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360278.005363:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.005395:0:18717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 8 pid: 18711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.005408:0:18717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 8 pid: 18711 timeout: 656 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360278.005440:0:18717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18717:1874182596150912:192.168.206.11@tcp:104: 00000100:00100000:0.0:1787360278.005526:0:18717:0:(client.c:2715:ptlrpc_set_wait()) set ffff998a3b98f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787360278.013037:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:1.0:1787360278.013076:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360278.013201:0:18719:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787360278.013211:0:18719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787360278.013618:0:20233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106304 00000100:00100000:2.0:1787360278.013638:0:20233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106304 00010000:00010000:2.0:1787360278.013686:0:20233:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 9 pid: 18711 timeout: 656 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360278.013729:0:20233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:2.0:1787360278.013739:0:20233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:2402:x1874182575106304:12345-192.168.206.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360278.013752:0:20233:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360278.013774:0:20233:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 9 pid: 18711 timeout: 656 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.013789:0:20233:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 9 pid: 18711 timeout: 656 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.013812:0:20233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360278.013817:0:20233:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360278.013822:0:20233:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.013832:0:20233:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.013850:0:20233:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360278.013899:0:20233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+9:2402:x1874182575106304:12345-192.168.206.11@tcp:103:ldlm_bl.0 Request processed in 161us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360278.013914:0:20233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00010000:00010000:0.0:1787360278.014714:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076a995fb/0x359a4e2aee721890 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.11@tcp remote: 0x7807fb8fcb4ef56b expref: 8 pid: 18711 timeout: 656 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360278.014741:0:18717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18717:1874182596150912:192.168.206.11@tcp:104: 00010000:00010000:0.0:1787360278.014762:0:18717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.014770:0:18717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360278.014777:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360278.015274:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106176 00000100:00100000:2.0:1787360278.015280:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106176 00000100:00100000:3.0:1787360278.016269:0:20346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 1 00000100:00100000:3.0:1787360278.016291:0:20346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+8:2399:x1874182575106176:12345-192.168.206.11@tcp:4:dd.0 00010000:00010000:3.0:1787360278.016321:0:20346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.016336:0:20346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360278.016340:0:20346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360278.016347:0:20346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.016359:0:20346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360278.134383:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1787360278.134406:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1787360278.135323:0:20346:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:3.0:1787360278.135331:0:20346:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787360276 -> 1787360277 00002000:00010000:3.0:1787360278.135334:0:20346:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787360276 -> 1787360277 00002000:00010000:3.0:1787360278.135336:0:20346:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:3.0:1787360278.135357:0:20346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135372:0:20346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135382:0:20346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135390:0:20346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a35040800 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:3.0:1787360278.135396:0:20346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135416:0:20346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135442:0:20346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360278.135450:0:20346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf19acf8/0x359a4e2aee7218d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360278.138701:0:20346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998904329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+7:2399:x1874182575106176:12345-192.168.206.11@tcp:4:dd.0 Request processed in 122399us (125655us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787360278.138721:0:20346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 1 00000001:00080000:0.0:1787360278.207531:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1787360278.207813:0:18717:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1787360278.207833:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207846:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207854:0:18717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207861:0:18717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff998a01689c00 already unused, calling callback (ffffffffc0ea2230) 00010000:00010000:2.0:1787360278.207867:0:18717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207875:0:18717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207892:0:18717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360278.207900:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df329ab1/0x359a4e2aee7218cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360278.208558:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2400:x1874182575106048:12345-192.168.206.11@tcp:4:dd.0 Request processed in 203262us (203633us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787360278.208581:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 0 00000100:00100000:3.0:1787360278.266135:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360278.266459:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596151040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787360278.266749:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360278.270511:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151040 00000100:00100000:2.0:1787360278.270525:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151040 00000100:00100000:2.0:1787360278.270607:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360278.270618:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596151040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787360278.270816:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1787360278.270906:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1874182596151040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 289us (4156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360278.270914:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360278.271012:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3660:1874182596151040:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787360278.271028:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787360278.973589:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360279.289591:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596151168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787360279.289658:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360279.289815:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151168 00000100:00100000:0.0:1787360279.289824:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151168 00000100:00100000:0.0:1787360279.289877:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787360279.289888:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596151168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787360279.289932:0:17948:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787360279.289993:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1874182596151168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360279.290001:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787360279.290044:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3658:1874182596151168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787360279.291388:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596151296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787360279.291436:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.291562:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151296 00000100:00100000:2.0:1787360279.291637:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151296 00000100:00100000:2.0:1787360279.291683:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787360279.291692:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596151296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787360279.291720:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787360279.291770:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890432a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596151296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.291776:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787360279.291888:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596151296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787360279.804697:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596151424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360279.804761:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360279.804811:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151424 00000100:00100000:3.0:1787360279.804819:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151424 00000100:00100000:3.0:1787360279.804870:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787360279.804883:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596151424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360279.804909:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787360279.804952:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998903b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596151424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360279.804982:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787360279.805002:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360279.805028:0:3660:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1787360279.805033:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff998904329880, transno 8589934596 00000004:00080000:3.0:1787360279.805044:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1787360279.805068:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998903b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596151424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360279.805927:0:3661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596151552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360279.805961:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360279.806010:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151552 00000100:00100000:0.0:1787360279.806014:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151552 00000100:00100000:0.0:1787360279.806047:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360279.806054:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596151552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360279.806073:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360279.806107:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1874182596151552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360279.806114:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787360279.806129:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360279.806154:0:3661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3661:1874182596151552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360279.807034:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360279.807045:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596151680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360279.807079:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360279.807108:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151680 00000100:00100000:0.0:1787360279.807112:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151680 00000100:00100000:0.0:1787360279.807143:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360279.807150:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596151680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787360279.807163:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787360279.807203:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ee5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1874182596151680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360279.807210:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787360279.807247:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360279.807269:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998904059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3659:1874182596151680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787360279.807640:0:3659:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596151808:0@lo:400:kworker.0 00000100:00100000:0.0:1787360279.807673:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360279.807871:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151808 00000100:00100000:1.0:1787360279.807876:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151808 00000100:00100000:1.0:1787360279.807917:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787360279.807924:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3659:x1874182596151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808183:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596151936:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808214:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808304:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596152448:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808330:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808348:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890539dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596152960:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808373:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808393:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787360279.808399:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596152064:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808429:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808445:0:3660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596152576:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808466:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808497:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596151936 00000100:00100000:2.0:1787360279.808501:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596151936 00000100:00100000:2.0:1787360279.808531:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360279.808538:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596151936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808576:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1874182596151936:12345-0@lo:400:kworker.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.808582:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360279.808602:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152448 00000100:00100000:2.0:1787360279.808607:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152448 00000100:00100000:2.0:1787360279.808624:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152960 00000100:00100000:2.0:1787360279.808626:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152960 00000100:00100000:2.0:1787360279.808646:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152064 00000100:00100000:2.0:1787360279.808649:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152064 00000100:00100000:2.0:1787360279.808660:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152576 00000100:00100000:2.0:1787360279.808662:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152576 00000100:00100000:2.0:1787360279.808675:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360279.808681:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596152448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808712:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1874182596152448:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.808718:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787360279.808730:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360279.808737:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596152960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808762:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1874182596152960:12345-0@lo:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.808777:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787360279.808789:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360279.808795:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596152064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808825:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1874182596152064:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.808830:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360279.808842:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787360279.808848:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596152576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808871:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1874182596152576:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.808876:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787360279.808903:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360279.808907:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360279.808916:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596152192:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808941:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.808960:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890539f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596152704:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.808994:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.809012:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787360279.809019:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff998a3cb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596152320:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809042:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.809062:0:3658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99890539f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596152832:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809083:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360279.809105:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152192 00000100:00100000:2.0:1787360279.809109:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152192 00000100:00100000:2.0:1787360279.809132:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787360279.809145:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596152192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809180:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596152192:12345-0@lo:400:kworker.0 Request processed in 36us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.809187:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787360279.809205:0:18711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152320 00000100:00100000:2.0:1787360279.809209:0:18711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152320 00000100:00100000:2.0:1787360279.809256:0:18711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360279.809263:0:18711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596152320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809292:0:18711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1874182596152320:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.809297:0:18711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360279.809316:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152704 00000100:00100000:2.0:1787360279.809319:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152704 00000100:00100000:2.0:1787360279.809342:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182596152832 00000100:00100000:2.0:1787360279.809345:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182596152832 00000100:00100000:2.0:1787360279.809362:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787360279.809368:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596152704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809397:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1874182596152704:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.809403:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787360279.809414:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787360279.809420:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596152832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809445:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1874182596152832:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360279.809451:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787360279.809467:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360279.809470:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787360279.809505:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596152320:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809516:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890539f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3658:1874182596152832:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809524:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3658:1874182596152192:0@lo:400:kworker.0 00010000:00080000:2.0:1787360279.809535:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890539f100 x1874182596152704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360279.809545:0:3658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890539f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3658:1874182596152704:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809576:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3660:1874182596152064:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809586:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890539ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3660:1874182596152576:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809594:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3660:1874182596151936:0@lo:400:kworker.0 00000100:00100000:2.0:1787360279.809603:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3660:1874182596152448:0@lo:400:kworker.0 00010000:00080000:2.0:1787360279.809613:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99890539dc00 x1874182596152960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360279.809622:0:3660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99890539dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3660:1874182596152960:0@lo:400:kworker.0 00000100:00100000:1.0:1787360279.812648:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9b5a46b1-7024-40db-b9fb-69c8c09a9227+24:3659:x1874182596151808:12345-0@lo:400:kworker.0 Request processed in 4716us (4966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360279.812662:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787360279.817507:0:3659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff998a3cb0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9b5a46b1-7024-40db-b9fb-69c8c09a9227:3659:1874182596151808:0@lo:400:kworker.0 00010000:00010000:3.0:1787360279.995989:0:17194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787360280.172077:0:20384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787360280.428218:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428299:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360280.428335:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106432 00000100:00100000:3.0:1787360280.428345:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106432 00000100:00100000:2.0:1787360280.428349:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428385:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360280.428398:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:2.0:1787360280.428400:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:3.0:1787360280.428408:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+13:2401:x1874182575106432:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360280.428416:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.11@tcp (source: 12345-192.168.206.11@tcp) 00000100:00100000:2.0:1787360280.428464:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106688 00000100:00100000:3.0:1787360280.428467:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff998a2ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:14e95e5c-9854-457b-a93b-73582689ff25+13:2401:x1874182575106432:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360280.428467:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106688 00000100:00100000:3.0:1787360280.428474:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 168 00000100:00100000:2.0:1787360280.428495:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107200 00000100:00100000:2.0:1787360280.428499:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107200 00000100:00100000:3.0:1787360280.428502:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106944 00000100:00100000:3.0:1787360280.428504:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106944 00000100:00100000:2.0:1787360280.428511:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106560 00000100:00100000:2.0:1787360280.428514:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106560 00000100:00100000:2.0:1787360280.428526:0:17241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107072 00000100:00100000:2.0:1787360280.428529:0:17241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107072 00000100:00100000:2.0:1787360280.428543:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:2.0:1787360280.428549:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106688:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360280.428579:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106688:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360280.428586:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 70 00000100:00100000:2.0:1787360280.428599:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360280.428605:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107200:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360280.428628:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107200:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360280.428635:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 71 00000100:00100000:2.0:1787360280.428646:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:2.0:1787360280.428653:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+22:2401:x1874182575106560:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360280.428679:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+22:2401:x1874182575106560:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360280.428685:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 72 00000100:00100000:2.0:1787360280.428697:0:17241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1787360280.428703:0:17241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575107072:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:2.0:1787360280.428728:0:17241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:924bac3c-3aca-4cde-8ca8-f46336646f6e+6:2401:x1874182575107072:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360280.428741:0:17241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 73 00000100:00100000:2.0:1787360280.428762:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107456 00000100:00100000:2.0:1787360280.428766:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107456 00000100:00100000:2.0:1787360280.428783:0:19590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575106816 00000100:00100000:3.0:1787360280.428784:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182575107328 00000100:00100000:2.0:1787360280.428786:0:19590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575106816 00000100:00100000:3.0:1787360280.428787:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182575107328 00000100:00100000:1.0:1787360280.429012:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360280.429022:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106944:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360280.429078:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106944:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 58us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360280.429085:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 21 00000100:00100000:1.0:1787360280.429099:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1787360280.429106:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107456:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:1.0:1787360280.429130:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107456:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360280.429136:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 22 00000100:00100000:1.0:1787360280.429148:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 23 00000100:00080000:2.0:1787360280.429435:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360280.430863:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:3.0:1787360280.430874:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107328:12345-192.168.206.11@tcp:400:kworker.0 00000100:00100000:3.0:1787360280.430928:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:924bac3c-3aca-4cde-8ca8-f46336646f6e+5:2401:x1874182575107328:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 57us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360280.430935:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 24 00000100:00100000:1.0:1787360280.432857:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99890539c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106816:12345-192.168.206.11@tcp:400:kworker.0 00000100:00080000:2.0:1787360280.432973:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787360280.432977:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787360280.432980:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787360280.433019:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99890539c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c5b69-4b93-4276-a9fb-fa611f6ac03d+5:2401:x1874182575106816:12345-192.168.206.11@tcp:400:kworker.0 Request processed in 3862us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360280.433029:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.11@tcp, seq: 23 00010000:00010000:0.0:1787360281.017545:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42648 lines, 42648 kept, 0 dropped, 0 bad.